-- Logs begin at Fri 2022-01-28 00:04:41 UTC, end at Fri 2022-01-28 01:12:54 UTC. -- Jan 28 00:42:49.422871 dv-cinder-809523-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 28 00:42:49.431989 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 28 00:42:49.433846 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 00:42:49 2022] *** Jan 28 00:42:49.433846 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 00:42:49.433846 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 00:42:49.433846 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: nodename: dv-cinder-809523-8-iscsi Jan 28 00:42:49.433846 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: machine: x86_64 Jan 28 00:42:49.433846 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: clock source: unix Jan 28 00:42:49.433846 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: pcre jit disabled Jan 28 00:42:49.433846 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: detected number of CPU cores: 4 Jan 28 00:42:49.433846 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: current working directory: / Jan 28 00:42:49.433846 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: detected binary path: /usr/bin/uwsgi-core Jan 28 00:42:49.434549 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: your processes number limit is 47680 Jan 28 00:42:49.434549 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: your memory page size is 4096 bytes Jan 28 00:42:49.434549 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: detected max file descriptor number: 2048 Jan 28 00:42:49.434549 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: lock engine: pthread robust mutexes Jan 28 00:42:49.434549 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: thunder lock: enabled Jan 28 00:42:49.434549 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 28 00:42:49.434549 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 00:42:49.480263 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: Python main interpreter initialized at 0x56243578a9c0 Jan 28 00:42:49.480263 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: python threads support enabled Jan 28 00:42:49.480263 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: your server socket listen backlog is limited to 100 connections Jan 28 00:42:49.480263 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: your mercy for graceful operations on workers is 90 seconds Jan 28 00:42:49.480686 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 00:42:49.480686 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: *** Operational MODE: preforking *** Jan 28 00:42:49.480981 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: *** uWSGI is running in multiple interpreter mode *** Jan 28 00:42:49.480981 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: spawned uWSGI master process (pid: 113340) Jan 28 00:42:49.481196 dv-cinder-809523-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 28 00:42:49.483808 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: spawned uWSGI worker 1 (pid: 113341, cores: 1) Jan 28 00:42:49.483808 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: spawned uWSGI worker 2 (pid: 113342, cores: 1) Jan 28 00:42:49.483808 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 00:42:51.376916 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 00:42:51.376916 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: from cryptography.utils import int_from_bytes Jan 28 00:42:51.377980 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 00:42:51.377980 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: from cryptography.utils import int_from_bytes Jan 28 00:42:51.465918 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 00:42:51.465918 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: from cryptography.utils import int_from_bytes Jan 28 00:42:51.466679 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 00:42:51.466679 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: from cryptography.utils import int_from_bytes Jan 28 00:42:54.173322 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 00:42:54.173884 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 00:42:54.174035 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 00:42:54.174363 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 00:42:54.174619 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 00:42:54.175012 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.175365 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.175693 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.176017 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.176361 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.176680 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.177014 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.177338 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.177682 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.177947 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.178375 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.178597 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-809523-8-iscsi {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.178922 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.179235 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.179586 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.179911 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.180222 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.180546 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.180859 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.181364 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.181817 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.182133 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.182450 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.182792 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.183108 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.183452 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.183778 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.184451 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.184792 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.185114 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.186478 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-809523-8-iscsi {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.186478 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.186478 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.186478 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.188437 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.188437 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.188437 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.188437 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.188437 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.188848 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.188848 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.189186 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.189515 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.189845 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.190158 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.190474 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.190793 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.191128 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.191639 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.191639 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.191639 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.192658 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.192658 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.193103 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.193331 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.193559 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.193803 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.194174 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.194465 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.194784 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.195110 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.195444 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.197074 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.197074 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.197074 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.197074 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.197074 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.197544 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.197623 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.197915 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.198231 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.198558 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.198973 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.199234 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.199856 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.200138 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.200380 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.200600 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.200889 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.201212 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.201532 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.201842 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.202155 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.202481 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.202823 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.203137 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.203419 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.203732 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.204044 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.204363 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.204677 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.204988 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.205299 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.205613 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.205918 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.206234 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.206547 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.206859 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.207169 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.207508 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.207824 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.208136 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.208449 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.208779 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.209107 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.209517 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.209731 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.210042 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.210357 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.210685 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.210998 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.211324 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.211679 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.211966 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.212282 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.212607 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.212918 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.213229 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.213553 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.213863 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.214178 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.214499 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.214809 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.215120 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.216064 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.216382 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.216687 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.217003 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.217314 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.217629 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.217931 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.218288 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.218586 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.218902 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.219215 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.219570 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.219880 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.220225 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.220564 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.220913 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.221235 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.221573 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.221911 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.223175 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.223175 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.223175 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.223175 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.223706 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.224148 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.224541 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.224936 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.225328 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.225740 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.226130 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.226521 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.226922 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.227348 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.228357 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.228357 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.228631 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.228925 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.229348 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.229800 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.230218 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.230615 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.231706 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.232078 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.232506 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.232897 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.233286 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.233698 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.234131 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.234519 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.234934 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.235487 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.235854 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.236240 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.236621 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.237008 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.237394 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.237775 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.238171 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.238952 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.238952 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.239397 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.239792 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.240292 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.240973 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.241401 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.241827 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.242305 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.242725 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.243140 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.243613 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.244045 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.244461 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.244928 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.245391 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.245939 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.246174 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.246595 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.246986 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.247471 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.247892 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.248280 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.248669 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.249084 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.249514 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.249897 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.250358 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.250763 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.251152 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.251572 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.252004 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.252465 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.252893 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.253305 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.253730 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.254145 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.254557 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.254968 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.255425 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.255873 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.256313 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.256736 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.257146 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.257564 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.257976 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.258443 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.258856 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.259336 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.259809 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.260234 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.260726 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.261154 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.261576 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.261987 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.262799 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.263132 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.263587 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.264026 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.264453 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.264879 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.265296 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.265727 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.266222 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.266663 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.267075 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.267405 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 00:42:54.268120 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.268274 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 00:42:54.268447 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.268727 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.268886 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 00:42:54.269223 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.269382 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 00:42:54.269717 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.269877 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 00:42:54.270196 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.270501 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.270720 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.271084 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.271177 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.271626 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.271769 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.271988 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.272264 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.272413 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.273008 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.273201 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.273330 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.273452 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.273733 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.273922 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.274458 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.274572 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.274717 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.274936 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.275030 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.275540 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.275705 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.275867 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.275961 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.276287 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.276658 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-809523-8-iscsi {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.276756 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.276837 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.277151 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.277473 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.277583 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.278320 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.278809 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.278899 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.279293 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.279390 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.279746 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.279913 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.280254 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.280421 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.280742 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.281098 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.281291 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.281626 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.281785 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.282102 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.282264 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.282578 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.282738 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.283090 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.283328 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.283678 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.283844 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.284156 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.284302 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.284602 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.284744 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.285040 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.285197 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.285466 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.285610 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.285897 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.286038 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.286408 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.286604 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-809523-8-iscsi {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.286885 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.287088 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.287353 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.287602 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.287806 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.290312 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.290458 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.290458 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.290621 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.290773 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.290773 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.290971 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.291084 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.291167 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.291245 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.291339 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.291430 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.291430 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.291588 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.291674 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.291753 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.291836 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.291836 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.292156 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.292247 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.292247 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.292380 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.292446 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.292519 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.292690 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.292942 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.293028 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.293347 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.294011 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.294204 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.294437 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.294532 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.294823 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.294909 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.295143 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.297204 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.297378 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.297378 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.297642 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.297805 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.297948 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.298107 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.298254 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.298392 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.298392 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.298581 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.298662 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.298730 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.298835 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.298835 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.298972 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.299038 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.299116 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.299210 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.299331 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.299404 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.299469 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.299533 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.299803 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.300046 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.300145 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.300444 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.300566 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.300788 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.301111 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.301199 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.301432 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.301675 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.301759 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.302052 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.302204 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.302377 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.302673 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.302824 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.302986 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.303318 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.303467 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.303623 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.303818 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.303947 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.304310 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.304452 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.304589 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.304755 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.304885 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.305191 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.305339 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.305507 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.305718 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.305833 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.306147 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.306223 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.306469 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.306665 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.306783 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.307120 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.307194 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.307476 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.307791 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.307884 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.308102 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.308179 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.308413 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.308695 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.308776 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.309610 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.309837 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.309943 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.310278 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.310378 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.310792 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.310939 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.311106 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.311445 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.311537 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.311784 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.312034 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.312123 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.312395 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.312556 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.312708 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.313028 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.313129 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.313343 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.313657 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.313741 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.313975 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.314201 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.314317 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.314595 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.314812 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.314906 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.315203 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.315399 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.315567 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.315848 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.315934 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.316192 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.316404 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.316498 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.316806 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.316936 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.319480 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.319480 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.319700 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.319794 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.319882 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.319963 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.319963 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.320120 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.320187 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.320187 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.320385 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.320451 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.320515 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.320585 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.320585 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.320720 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.320787 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.320852 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.320921 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.320921 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.321045 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.321110 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.321378 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.321472 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.321675 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.321821 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.321988 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.322295 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.322387 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.322605 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.322764 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.322915 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.323233 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.323341 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.323590 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.323740 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.323916 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.324212 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.324305 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.324552 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.325354 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.325454 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.325831 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.325926 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.326238 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.326337 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.326531 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.326747 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.326829 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.327150 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.327244 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.327488 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.327723 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.327806 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.328100 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.328183 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.328447 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.328638 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.328742 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.329053 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.329127 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.329366 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.329818 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.330888 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.330888 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.331058 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.331182 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.331307 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.331392 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.331470 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.331598 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.331598 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.331742 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.331832 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.331920 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.332004 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.332219 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.332435 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.332543 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.332839 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.332932 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.333159 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.333385 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.333519 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.333789 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.333929 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.334096 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.334308 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.334452 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.334726 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.334928 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.335067 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.335384 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.335587 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.335745 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.335881 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.336026 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.336321 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.336471 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.336620 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.336827 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.336972 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.337243 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.337399 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.337552 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.337856 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.338003 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.338167 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.338416 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.338509 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.338785 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.338929 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.339103 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.339445 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.339532 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.339761 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.340068 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.340200 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.340413 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.340649 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.340831 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.341028 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.341149 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:42:54.341515 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.341760 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.341895 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.342135 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.342424 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.342548 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.342752 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.342954 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.343073 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.343416 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.343567 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.343871 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.344192 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.344289 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.344511 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.344824 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.344907 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.345142 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.345404 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.345504 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.345766 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.345944 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.346089 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.346402 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.346522 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.346836 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.347106 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.347261 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.347488 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.347689 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.347857 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.348106 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.348255 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.348397 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.348714 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.348859 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.349046 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.349329 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.349568 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.349693 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.349910 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.349996 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.350269 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.350509 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.350631 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.350896 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.351027 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.351362 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.351657 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.351849 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.352009 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.352245 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.352403 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.352696 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.352798 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.353013 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.353320 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.353418 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.353658 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.353930 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.354057 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.356202 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.356671 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.356844 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.356844 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.357732 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.357827 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.357827 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.357981 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.358062 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.358062 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.358213 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.358281 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.358345 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.358409 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.358409 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.358545 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.358625 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.358625 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.358763 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.358840 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.358917 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.359008 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.359008 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.359154 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.359232 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.359572 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.359670 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.359886 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.360202 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.360295 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.360519 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.360774 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.360883 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.361129 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.361344 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.361494 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.361778 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.361928 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.362088 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.362395 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.362542 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.362706 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.363023 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.363166 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.363353 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.363646 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.363741 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.363987 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.364177 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.364297 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.364625 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.364742 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.364954 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.365267 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.365379 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.365584 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.366099 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.366193 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.366476 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.366596 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.366794 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.367112 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.367314 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.367447 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.367778 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.367929 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.368072 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.368322 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.368468 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.368813 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.368950 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.369237 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.369416 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.369567 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.369890 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.370030 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.370226 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.370440 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.370592 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.370865 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.371024 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.371197 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.372067 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.372188 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.372387 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.372642 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.372803 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.373031 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.373123 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.373447 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.373602 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.374429 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.374537 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.374620 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.374701 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.374883 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.375158 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.375337 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.375541 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.375634 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.375888 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.376029 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.376201 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.376509 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.376610 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.376855 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.376999 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.377170 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.377485 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.377573 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.377795 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.377962 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.378150 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.378439 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.378526 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.378800 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.378930 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.379132 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.379449 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.379555 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.379818 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.379976 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.380139 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.380469 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.380603 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.380793 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.381118 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.381216 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.381440 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.381871 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.382039 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.382180 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.382314 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.382454 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.382677 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.382828 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.382974 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.383243 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.383402 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.384865 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.385020 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.385153 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.385309 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.385530 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.385620 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.385709 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.385709 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.385865 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.385946 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.386025 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.386117 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.386117 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.386260 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.386352 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.386678 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.386825 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.386990 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.387889 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.388030 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.388200 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.388416 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.388556 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.388852 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.388949 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.389190 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.389501 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.389595 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.389856 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.390076 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.390182 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.390506 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.390582 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.390830 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.391227 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.391348 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.391578 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.391680 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.391853 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.392178 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.392260 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.392505 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.392822 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.392934 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.393137 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.393243 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.393455 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.393777 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.393958 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.394097 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.394419 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.394519 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.394738 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.394943 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.395048 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.395393 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.395526 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.395729 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.396072 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.396171 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.396406 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.396638 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.396788 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.397049 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.397181 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.397374 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.397687 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.397943 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.398253 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.398357 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.398594 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.398777 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.398932 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.399288 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.399443 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.399616 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.399764 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.399928 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.400270 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.400380 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.400582 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.400867 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.401027 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.401358 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.401473 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.401683 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.401942 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.402045 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.402317 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.402525 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.402627 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.403494 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.403635 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.403832 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.404143 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.404256 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.404684 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.404786 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.405062 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.405273 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.405370 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.405712 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.405945 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.406081 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.406384 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.406481 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.406714 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.406949 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.407050 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.407372 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.407556 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.407689 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.408022 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.408211 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.408364 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.408581 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.408731 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.408940 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.409148 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.409291 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.409563 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.409703 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.409879 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.410184 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.410276 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.410494 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.410670 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.410828 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.411148 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.411252 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.411567 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.411732 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.411847 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.412112 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.412241 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.412425 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.412726 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.412837 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.414424 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.414570 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.414718 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.414718 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.415087 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.415229 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.415229 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.415425 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.415519 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.415519 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.415672 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.416091 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.416091 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.416252 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.416343 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.416425 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.416504 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.416504 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.416701 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.416791 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.417001 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.417331 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.417468 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.417638 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.417726 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.417958 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.418448 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.419064 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.419433 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.419860 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.419992 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.420083 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.420373 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.420666 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.422049 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.422049 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.422289 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.422442 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.422442 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.422608 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.422755 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.422755 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.422986 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.423070 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.423150 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.423229 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.423229 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.423501 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.423607 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.423845 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.424000 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.424165 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.424468 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.424555 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.424789 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.425076 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.425154 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.425444 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.425666 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.425768 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.426063 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.426237 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.426390 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.426722 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.426830 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.427076 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.427531 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.427678 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.427807 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.427993 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.428130 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.428371 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.428520 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.428694 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.428845 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.429018 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.429323 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.429475 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.429643 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.429829 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.429995 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.430294 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.430421 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.430615 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.430777 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.430910 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.431236 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.431454 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.431692 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.431816 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.432067 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.432257 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.432441 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.432707 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.432853 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.433037 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.433191 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.433370 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.433657 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.433799 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.434027 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.434223 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.434401 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.434673 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.434841 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.435023 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.435390 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.435572 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.435710 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.435907 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.436014 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.436330 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.436428 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.436650 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.436861 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.436953 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.437284 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.437369 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.437635 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.437822 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.437961 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.438268 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.438396 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.438585 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.438722 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.438917 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.439194 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.439305 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.439579 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.439722 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.439905 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.440175 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.440284 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.440544 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.440678 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.440887 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.441168 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.441308 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.441512 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.441654 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.441832 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.442096 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.442254 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.442504 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.442636 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.442824 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.443033 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.443171 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.443515 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.443832 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.443985 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.444167 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.444438 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.444610 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.444813 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.445049 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.445199 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.445440 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.445580 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.445786 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.446019 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.446204 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.446398 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.446532 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.446717 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.446972 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.447103 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.447366 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.447501 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.447694 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.447971 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.448120 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.448352 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.448488 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.448686 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.448897 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.449057 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.449364 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.449503 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.450215 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.450577 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.450853 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.451030 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.451361 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.451522 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.451766 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.451902 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.452083 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.452282 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.452418 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113342) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 00:42:54.452748 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.453244 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.453724 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.454279 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.454833 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.455375 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.455950 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.456510 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.457021 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.457509 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.458113 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.458672 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.459165 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.459745 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.460298 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.460924 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.461449 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.462061 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.462634 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.463238 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.463830 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.464366 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.464960 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.466384 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.466955 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.467551 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.468105 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.468673 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.469210 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.469709 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.470199 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.470723 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.471226 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.471763 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.473171 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.473171 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.473477 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.473952 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.474497 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.475043 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.475650 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.476184 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.476778 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.477331 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.477514 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG oslo_db.sqlalchemy.engines [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:42:54.477879 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.478657 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.478989 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.479510 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.480065 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.480555 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.481075 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.481554 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.482069 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.482556 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.483027 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.483534 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.484067 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.484614 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.485143 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.486503 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.486503 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.490430 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.490430 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.490430 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.490430 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.490430 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.490430 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.490430 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.490430 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.491787 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.491787 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.492057 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.492566 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.493158 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.493726 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.494220 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.494732 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.495337 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.495914 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.496704 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.497069 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.497735 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.498152 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.498882 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.499290 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.499874 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.500458 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.501010 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.501703 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.502129 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.502699 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.503244 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.503832 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.504423 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.504969 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.505546 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.506108 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.506676 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.507288 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.507862 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.508442 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.508987 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.509484 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.509980 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.510477 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.510969 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.511486 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.512531 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.513109 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.513688 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.514269 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.514852 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.515411 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.515900 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.516485 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.517104 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.517630 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.518200 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.518758 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.519261 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.519773 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.520521 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.521084 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.521644 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.522153 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.522646 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.523154 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.523692 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.524189 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.524666 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.525324 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.525801 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.526276 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.526756 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.527225 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.528348 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.529056 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.529421 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.529901 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.530392 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.530895 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.531463 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.532013 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.532586 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.533250 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.533754 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.534305 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.535038 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.535634 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.536200 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.536733 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.537238 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.537741 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.538243 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.538816 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.539479 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.539930 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.540985 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.540985 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.541398 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.541870 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.542373 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.542860 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.543972 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.544546 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.545041 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.context [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f15678a-aa46-4c92-970a-a19695f4d8dc(cell1) {{(pid=113342) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 00:42:54.545316 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.546002 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.546561 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.547151 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.547799 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.548282 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.548830 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.549408 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG oslo_concurrency.lockutils [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:42:54.549593 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.549939 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.550547 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.550985 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.551088 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG oslo_concurrency.lockutils [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:42:54.551504 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.551916 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG oslo_concurrency.lockutils [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:42:54.552075 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.552458 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.552937 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.553439 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.553966 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG oslo_concurrency.lockutils [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113342) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:42:54.554100 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.554540 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.555030 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.555581 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.556079 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.556648 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.557458 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.557990 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.558588 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.559907 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.560413 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.560948 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.561513 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.562082 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.562600 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.563189 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.564045 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.564403 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.564974 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.565580 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.566184 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.566689 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG oslo_db.sqlalchemy.engines [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:42:54.566792 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.567348 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.567931 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.568465 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.569037 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.569591 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.569741 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG oslo_db.sqlalchemy.engines [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:42:54.570156 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.570725 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.571296 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.571865 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.572422 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.572960 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.573494 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.574101 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.574670 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.575192 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.575801 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.576311 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.577270 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.577379 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.578937 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.578937 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.579172 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.579557 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.580167 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.580748 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.581269 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.581860 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.582440 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.582959 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.583491 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.584051 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.584623 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.585158 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.585657 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.586226 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.586801 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.589047 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.589047 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.589047 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.590070 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.590070 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.590622 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.591117 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.591651 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.592161 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.592726 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.593294 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.594041 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.594442 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.595033 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.595669 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.596252 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.599523 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.599523 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.599523 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.599523 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.599523 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.600121 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.600312 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.600849 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.601426 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.601975 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.602479 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.603006 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.603615 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.604176 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.604748 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.605332 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.606392 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.606898 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.607473 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.608067 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.608661 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.609200 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.609785 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.610366 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.610913 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.611921 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.612453 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.613058 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.613660 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.614181 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.614744 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.615341 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.616180 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.616691 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.617154 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.617644 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.618129 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.618604 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.619102 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.619621 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.620105 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.620608 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.621106 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.622130 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.623077 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.623610 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.624118 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.624680 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.625240 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.625785 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.626303 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.626858 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.627466 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.628017 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.628587 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.629118 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.629663 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.630229 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.630792 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.631375 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.631911 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.632473 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.633037 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.633559 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.634062 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.634619 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.635156 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.635752 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.636313 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.636823 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.637347 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.637909 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.638469 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.639024 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.639622 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.640305 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.641200 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.641323 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.641838 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.642436 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.643001 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.643570 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.644163 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.644714 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.645320 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.645888 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.646458 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.647240 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.647848 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.648924 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.649538 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.650111 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.650709 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.651334 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.651839 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.652389 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.652983 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.653542 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.654038 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.654608 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.655182 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.655755 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.656321 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.657178 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.657468 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.658039 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.658595 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.659398 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.660024 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.660770 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.661152 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.661733 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.662310 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.662843 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.663376 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.663951 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.664518 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.665023 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.665516 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.666013 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.666528 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.667019 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.668991 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.668991 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.669488 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.670122 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.670677 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.671334 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.671864 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.672441 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.673011 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.673652 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.674132 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.674737 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.675376 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.675990 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.676585 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.677083 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.677608 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.678174 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.678725 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.679339 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.679954 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.680505 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.681096 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.681668 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.682201 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.682779 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.683397 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.683995 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.685152 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.685721 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.686277 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.686770 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.687303 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.687800 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.688288 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.688776 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.689261 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.689786 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.690325 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.690814 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.691354 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.691911 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.692485 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.693023 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.693592 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.694191 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.694692 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.695210 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.695802 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.696367 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.696916 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.697505 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.698068 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.698587 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.699096 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.700246 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.700887 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.701428 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.704060 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.704060 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.704060 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.704060 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.704360 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:42:54.704762 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 00:42:54.747094 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_db.sqlalchemy.engines [None req-832a1a52-a0c0-496d-8610-28129d97b1b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:42:54.749750 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG oslo_db.sqlalchemy.engines [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113342) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:42:54.819494 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.context [None req-832a1a52-a0c0-496d-8610-28129d97b1b0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f15678a-aa46-4c92-970a-a19695f4d8dc(cell1) {{(pid=113341) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 00:42:54.824019 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-832a1a52-a0c0-496d-8610-28129d97b1b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:42:54.827487 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-832a1a52-a0c0-496d-8610-28129d97b1b0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:42:54.828449 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-832a1a52-a0c0-496d-8610-28129d97b1b0 None None] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:42:54.830690 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-832a1a52-a0c0-496d-8610-28129d97b1b0 None None] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:42:54.844035 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_db.sqlalchemy.engines [None req-832a1a52-a0c0-496d-8610-28129d97b1b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:42:54.847338 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_db.sqlalchemy.engines [None req-832a1a52-a0c0-496d-8610-28129d97b1b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:42:55.025388 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_db.sqlalchemy.engines [None req-832a1a52-a0c0-496d-8610-28129d97b1b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:42:55.127656 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: WARNING keystonemiddleware.auth_token [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 00:42:55.134356 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: WARNING keystonemiddleware.auth_token [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 00:42:55.410727 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: WARNING keystonemiddleware.auth_token [None req-832a1a52-a0c0-496d-8610-28129d97b1b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 00:42:55.417442 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: WARNING keystonemiddleware.auth_token [None req-832a1a52-a0c0-496d-8610-28129d97b1b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 00:42:55.510937 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: WARNING keystonemiddleware.auth_token [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 00:42:55.516482 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: WARNING keystonemiddleware.auth_token [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 00:42:55.521993 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56243578a9c0 pid: 113342 (default app) Jan 28 00:42:55.524355 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:42:55.525612 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002005 Jan 28 00:42:55.526061 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Fri Jan 28 00:42:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:42:55.783574 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: WARNING keystonemiddleware.auth_token [None req-832a1a52-a0c0-496d-8610-28129d97b1b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 00:42:55.788842 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: WARNING keystonemiddleware.auth_token [None req-832a1a52-a0c0-496d-8610-28129d97b1b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 00:42:55.794957 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56243578a9c0 pid: 113341 (default app) Jan 28 00:44:29.674934 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:44:29.676121 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Jan 28 00:44:29.687194 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 930 bytes} [Fri Jan 28 00:44:29 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:44:30.204606 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-1ae2142c-fc28-4218-bd94-9c8fdf623dbe admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:44:30.237806 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-1ae2142c-fc28-4218-bd94-9c8fdf623dbe admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.552527 Jan 28 00:44:30.238753 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1291 bytes} [Fri Jan 28 00:44:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:44:32.741948 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:44:32.743981 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-e87fda9f-0247-4cbe-9e86-dbddc9ee6873 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002334 Jan 28 00:44:32.747708 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 930 bytes} [Fri Jan 28 00:44:32 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:44:32.812857 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-c6df65b4-f73c-4558-873b-823dde653a0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "disk": 1, "os-flavor-access:is_public": true}} {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:44:32.832310 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:44:32.832310 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: warnings.warn(msg) Jan 28 00:44:32.867591 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-c6df65b4-f73c-4558-873b-823dde653a0d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.115907 Jan 28 00:44:32.868536 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1282 bytes} [Fri Jan 28 00:44:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:44:33.105182 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-8cfea3f9-2f8f-4257-a77e-3aac78c0fb9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:44:33.107639 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:44:33.107639 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: warnings.warn(msg) Jan 28 00:44:33.161509 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-8cfea3f9-2f8f-4257-a77e-3aac78c0fb9d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284712 Jan 28 00:44:33.162336 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1335 bytes} [Fri Jan 28 00:44:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:44:35.545445 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-c6df65b4-f73c-4558-873b-823dde653a0d admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:44:35.546389 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-c6df65b4-f73c-4558-873b-823dde653a0d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jan 28 00:44:35.546794 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 930 bytes} [Fri Jan 28 00:44:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:44:35.655842 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-ba36132a-9b87-4fe1-b4d9-a7496ad487e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "disk": 5, "os-flavor-access:is_public": true}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:44:35.673949 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:44:35.673949 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: warnings.warn(msg) Jan 28 00:44:35.693367 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-ba36132a-9b87-4fe1-b4d9-a7496ad487e1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140563 Jan 28 00:44:35.694659 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1282 bytes} [Fri Jan 28 00:44:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:44:35.706528 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-b8ac3722-04a0-4176-bf98-fe6968437bf5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:44:35.708154 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:44:35.708154 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: warnings.warn(msg) Jan 28 00:44:35.745896 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-b8ac3722-04a0-4176-bf98-fe6968437bf5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042849 Jan 28 00:44:35.746506 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1335 bytes} [Fri Jan 28 00:44:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:44:38.106730 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-ba36132a-9b87-4fe1-b4d9-a7496ad487e1 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:44:38.107942 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-ba36132a-9b87-4fe1-b4d9-a7496ad487e1 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002076 Jan 28 00:44:38.108496 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 930 bytes} [Fri Jan 28 00:44:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:44:38.184112 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-873843f6-7d6a-448c-972c-684d0b83c6ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:44:38.218530 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-873843f6-7d6a-448c-972c-684d0b83c6ee admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.103718 Jan 28 00:44:38.220517 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1282 bytes} [Fri Jan 28 00:44:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:44:38.233544 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-f2367b48-d54f-48c1-aa68-67206064592b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:44:38.265879 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-f2367b48-d54f-48c1-aa68-67206064592b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036123 Jan 28 00:44:38.274552 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1335 bytes} [Fri Jan 28 00:44:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:44:40.893108 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-873843f6-7d6a-448c-972c-684d0b83c6ee admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:44:40.894247 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-873843f6-7d6a-448c-972c-684d0b83c6ee admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Jan 28 00:44:40.894750 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 930 bytes} [Fri Jan 28 00:44:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:44:40.963648 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-d3886ec2-1e8e-4f5f-82d1-f5baf44e534b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "id": "d3", "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "disk": 10}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:44:40.983131 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-d3886ec2-1e8e-4f5f-82d1-f5baf44e534b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080941 Jan 28 00:44:40.983727 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1282 bytes} [Fri Jan 28 00:44:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:44:40.998084 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-b089dbfc-5f4b-4205-aa07-6c77586ab4f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:44:41.025862 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-b089dbfc-5f4b-4205-aa07-6c77586ab4f7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033882 Jan 28 00:44:41.026500 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1335 bytes} [Fri Jan 28 00:44:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:44:43.499077 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-d3886ec2-1e8e-4f5f-82d1-f5baf44e534b admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:44:43.501123 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-d3886ec2-1e8e-4f5f-82d1-f5baf44e534b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002467 Jan 28 00:44:43.501542 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 930 bytes} [Fri Jan 28 00:44:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:44:43.582357 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-51cf6ad7-9761-4f0d-b138-ea1615840e2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 4096, "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0}} {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:44:43.603421 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-51cf6ad7-9761-4f0d-b138-ea1615840e2c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.094314 Jan 28 00:44:43.612014 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1282 bytes} [Fri Jan 28 00:44:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:44:43.620490 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-4c66e56c-96d2-42ec-83e4-dfe86cb4e47d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:44:43.647776 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-4c66e56c-96d2-42ec-83e4-dfe86cb4e47d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030977 Jan 28 00:44:43.648384 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1335 bytes} [Fri Jan 28 00:44:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:44:46.432339 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-51cf6ad7-9761-4f0d-b138-ea1615840e2c admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:44:46.433650 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-51cf6ad7-9761-4f0d-b138-ea1615840e2c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001741 Jan 28 00:44:46.434475 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 930 bytes} [Fri Jan 28 00:44:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:44:46.528631 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-84c5c149-6c89-473c-9f45-0c0843d98644 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:44:46.556087 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-84c5c149-6c89-473c-9f45-0c0843d98644 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.115242 Jan 28 00:44:46.557302 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1291 bytes} [Fri Jan 28 00:44:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:44:49.565907 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-51cf6ad7-9761-4f0d-b138-ea1615840e2c admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:44:49.566931 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-51cf6ad7-9761-4f0d-b138-ea1615840e2c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jan 28 00:44:49.567409 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 930 bytes} [Fri Jan 28 00:44:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:44:49.635672 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-8ffef6d4-6722-4175-ba74-86ba7b820e49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "id": "1", "name": "m1.tiny", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:44:49.655069 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-8ffef6d4-6722-4175-ba74-86ba7b820e49 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080554 Jan 28 00:44:49.655691 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1282 bytes} [Fri Jan 28 00:44:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:44:49.670057 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-b7e69e81-5fe1-45e2-afdd-7897ce76e83f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:44:49.696042 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-b7e69e81-5fe1-45e2-afdd-7897ce76e83f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029748 Jan 28 00:44:49.696638 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1332 bytes} [Fri Jan 28 00:44:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:44:53.107739 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-8ffef6d4-6722-4175-ba74-86ba7b820e49 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:44:53.109681 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-8ffef6d4-6722-4175-ba74-86ba7b820e49 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002500 Jan 28 00:44:53.110301 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 930 bytes} [Fri Jan 28 00:44:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:44:53.177083 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-9eaa275d-4851-4f26-b4bd-dca20c89221e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 20, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:44:53.198074 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-9eaa275d-4851-4f26-b4bd-dca20c89221e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080902 Jan 28 00:44:53.199038 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1282 bytes} [Fri Jan 28 00:44:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:44:53.211396 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-9dcbb6f6-01e2-4d44-90fc-2a66fc71846c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:44:53.234471 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-9dcbb6f6-01e2-4d44-90fc-2a66fc71846c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027254 Jan 28 00:44:53.235056 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1332 bytes} [Fri Jan 28 00:44:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:44:55.531737 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-9eaa275d-4851-4f26-b4bd-dca20c89221e admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:44:55.533042 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-9eaa275d-4851-4f26-b4bd-dca20c89221e admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001768 Jan 28 00:44:55.533477 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 930 bytes} [Fri Jan 28 00:44:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:44:55.593509 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-406f3b6d-9cc0-4f1d-a7c5-cb49cdb6257d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "vcpus": 2, "id": "3", "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:44:55.612689 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-406f3b6d-9cc0-4f1d-a7c5-cb49cdb6257d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071846 Jan 28 00:44:55.613244 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1282 bytes} [Fri Jan 28 00:44:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:44:55.625857 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-fb3675eb-e78a-44ac-9dd1-e2787db29cca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:44:55.650328 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-fb3675eb-e78a-44ac-9dd1-e2787db29cca admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028226 Jan 28 00:44:55.650978 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1332 bytes} [Fri Jan 28 00:44:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:44:58.348995 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-406f3b6d-9cc0-4f1d-a7c5-cb49cdb6257d admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:44:58.350049 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-406f3b6d-9cc0-4f1d-a7c5-cb49cdb6257d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jan 28 00:44:58.350715 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 930 bytes} [Fri Jan 28 00:44:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:44:58.420606 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-4ee458d7-6e8e-467a-b5f8-3b73906fa343 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4, "rxtx_factor": 1.0, "name": "m1.large", "os-flavor-access:is_public": true, "ram": 8192, "swap": 0}} {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:44:58.442833 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-4ee458d7-6e8e-467a-b5f8-3b73906fa343 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085825 Jan 28 00:44:58.443971 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1282 bytes} [Fri Jan 28 00:44:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:44:58.455855 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-ca457874-e4b2-4699-be0e-5369f701365d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:44:58.484547 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-ca457874-e4b2-4699-be0e-5369f701365d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032535 Jan 28 00:44:58.485145 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1332 bytes} [Fri Jan 28 00:44:58 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:45:00.846870 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-4ee458d7-6e8e-467a-b5f8-3b73906fa343 admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:00.848723 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-4ee458d7-6e8e-467a-b5f8-3b73906fa343 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002933 Jan 28 00:45:00.849414 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 930 bytes} [Fri Jan 28 00:45:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:45:00.924780 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-f5a1e9e9-fbf5-4312-9672-58bebf9921cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "disk": 160, "id": "5", "swap": 0, "rxtx_factor": 1.0}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:45:00.950324 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-f5a1e9e9-fbf5-4312-9672-58bebf9921cb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.093925 Jan 28 00:45:00.951099 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1282 bytes} [Fri Jan 28 00:45:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:45:00.967035 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-04cc9fbf-88e4-49cc-9d5c-726ef23b4363 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:45:00.992729 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-04cc9fbf-88e4-49cc-9d5c-726ef23b4363 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029275 Jan 28 00:45:00.993320 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1332 bytes} [Fri Jan 28 00:45:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:45:22.646991 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-f5a1e9e9-fbf5-4312-9672-58bebf9921cb admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:22.648293 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-f5a1e9e9-fbf5-4312-9672-58bebf9921cb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002374 Jan 28 00:45:22.648709 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 930 bytes} [Fri Jan 28 00:45:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:45:22.707955 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-8d560c61-2dc4-4084-8725-d7ffa5bcb7a7 admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:22.726986 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-8d560c61-2dc4-4084-8725-d7ffa5bcb7a7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072014 Jan 28 00:45:22.727599 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1291 bytes} [Fri Jan 28 00:45:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:45:24.151333 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-f5a1e9e9-fbf5-4312-9672-58bebf9921cb admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:24.152338 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-f5a1e9e9-fbf5-4312-9672-58bebf9921cb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jan 28 00:45:24.152743 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Jan 28 00:45:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:45:24.349194 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-9379ad4f-8018-40e1-b788-3c89e49a493d admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:24.355084 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.wsgi [None req-9379ad4f-8018-40e1-b788-3c89e49a493d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 28 00:45:24.355706 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-9379ad4f-8018-40e1-b788-3c89e49a493d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:45:24.356514 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-9379ad4f-8018-40e1-b788-3c89e49a493d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062140 Jan 28 00:45:24.357056 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Fri Jan 28 00:45:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 00:45:24.366827 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-99f45d08-94cf-4281-a50f-03e05f3cf183 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:24.388116 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-99f45d08-94cf-4281-a50f-03e05f3cf183 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025018 Jan 28 00:45:24.388694 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Jan 28 00:45:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:45:24.399647 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-257795c1-692d-4741-81e4-d641f51be302 admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:24.421642 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-257795c1-692d-4741-81e4-d641f51be302 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026633 Jan 28 00:45:24.422233 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Jan 28 00:45:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:45:24.432609 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-3116cffd-af19-430a-a60c-7e171b46c70f admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:24.438090 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.wsgi [None req-3116cffd-af19-430a-a60c-7e171b46c70f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 28 00:45:24.438658 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-3116cffd-af19-430a-a60c-7e171b46c70f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:45:24.439491 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-3116cffd-af19-430a-a60c-7e171b46c70f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010527 Jan 28 00:45:24.440011 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Fri Jan 28 00:45:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 00:45:25.963821 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-257795c1-692d-4741-81e4-d641f51be302 admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:25.964822 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-257795c1-692d-4741-81e4-d641f51be302 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jan 28 00:45:25.965237 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Jan 28 00:45:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:45:26.159882 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-cbcaf595-782e-4437-bed1-45fe17d4e86c admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:26.165756 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.wsgi [None req-cbcaf595-782e-4437-bed1-45fe17d4e86c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 28 00:45:26.166315 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-cbcaf595-782e-4437-bed1-45fe17d4e86c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:45:26.167099 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-cbcaf595-782e-4437-bed1-45fe17d4e86c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059524 Jan 28 00:45:26.167642 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Fri Jan 28 00:45:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 00:45:26.176994 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-7d0d7139-242b-4de3-9bc6-c7e45dc12b81 admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:26.190160 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-7d0d7139-242b-4de3-9bc6-c7e45dc12b81 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016644 Jan 28 00:45:26.190692 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Jan 28 00:45:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:45:26.200320 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-aa79d909-b109-452e-8fd0-7844cb80d8da admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:26.214249 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-aa79d909-b109-452e-8fd0-7844cb80d8da admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017402 Jan 28 00:45:26.214777 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Jan 28 00:45:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:45:26.223831 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-c3505908-2beb-4ddd-8958-095fb8ade421 admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:26.229802 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.wsgi [None req-c3505908-2beb-4ddd-8958-095fb8ade421 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 28 00:45:26.230371 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-c3505908-2beb-4ddd-8958-095fb8ade421 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:45:26.231159 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-c3505908-2beb-4ddd-8958-095fb8ade421 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010922 Jan 28 00:45:26.231703 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Fri Jan 28 00:45:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 00:45:27.522805 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-aa79d909-b109-452e-8fd0-7844cb80d8da admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:27.523827 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-aa79d909-b109-452e-8fd0-7844cb80d8da admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jan 28 00:45:27.524219 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Jan 28 00:45:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:45:27.720095 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-71ee8c81-ebc9-42c0-ae35-aff9040d75d3 admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:27.728052 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.wsgi [None req-71ee8c81-ebc9-42c0-ae35-aff9040d75d3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 28 00:45:27.729339 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-71ee8c81-ebc9-42c0-ae35-aff9040d75d3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:45:27.731599 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-71ee8c81-ebc9-42c0-ae35-aff9040d75d3 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.064746 Jan 28 00:45:27.732551 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Jan 28 00:45:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 00:45:27.742590 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-d8f43c25-5092-41f1-96ca-e00534df6601 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:27.756413 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-d8f43c25-5092-41f1-96ca-e00534df6601 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017830 Jan 28 00:45:27.756969 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Jan 28 00:45:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:45:27.767109 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-73014ca1-22db-4247-a314-02c4a837b9d5 admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:27.781622 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-73014ca1-22db-4247-a314-02c4a837b9d5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018351 Jan 28 00:45:27.782200 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Fri Jan 28 00:45:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:45:27.792186 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-17f5eeca-8e9b-41c4-8f05-b887dee8dd5e admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:27.797503 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.wsgi [None req-17f5eeca-8e9b-41c4-8f05-b887dee8dd5e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 28 00:45:27.798064 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-17f5eeca-8e9b-41c4-8f05-b887dee8dd5e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113342) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:45:27.798850 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-17f5eeca-8e9b-41c4-8f05-b887dee8dd5e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010236 Jan 28 00:45:27.799384 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Jan 28 00:45:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 28 00:45:29.095094 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-73014ca1-22db-4247-a314-02c4a837b9d5 admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:29.096152 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-73014ca1-22db-4247-a314-02c4a837b9d5 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jan 28 00:45:29.096577 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Jan 28 00:45:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:45:29.298118 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-a13fd28a-249f-4acb-82a7-85bf34ff6cc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:45:29.317354 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-a13fd28a-249f-4acb-82a7-85bf34ff6cc9 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.074249 Jan 28 00:45:29.317831 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Fri Jan 28 00:45:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:45:30.638287 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-73014ca1-22db-4247-a314-02c4a837b9d5 admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:30.639376 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-73014ca1-22db-4247-a314-02c4a837b9d5 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jan 28 00:45:30.639793 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Jan 28 00:45:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:45:30.838631 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-3d5a27f3-2ec7-4482-ba2e-5f2ae4cfec26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:45:30.857567 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-3d5a27f3-2ec7-4482-ba2e-5f2ae4cfec26 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070970 Jan 28 00:45:30.858035 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Fri Jan 28 00:45:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:45:32.205610 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-73014ca1-22db-4247-a314-02c4a837b9d5 admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:32.206632 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-73014ca1-22db-4247-a314-02c4a837b9d5 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jan 28 00:45:32.207049 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Jan 28 00:45:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:45:32.422298 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-afbbed89-9dc7-4ede-8307-84ba6d21e920 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:45:32.446225 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-afbbed89-9dc7-4ede-8307-84ba6d21e920 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.085336 Jan 28 00:45:32.446794 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Fri Jan 28 00:45:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:45:33.784141 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-73014ca1-22db-4247-a314-02c4a837b9d5 admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:33.785611 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-73014ca1-22db-4247-a314-02c4a837b9d5 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001810 Jan 28 00:45:33.786208 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Jan 28 00:45:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:45:33.984623 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-309f8306-52d2-45de-bd4a-f6c6ed993038 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:45:34.004237 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-309f8306-52d2-45de-bd4a-f6c6ed993038 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.073503 Jan 28 00:45:34.004707 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Fri Jan 28 00:45:33 2022] POST /compute/v2.1/flavors => generated 409 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:45:35.429539 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-73014ca1-22db-4247-a314-02c4a837b9d5 admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:35.430752 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-73014ca1-22db-4247-a314-02c4a837b9d5 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001723 Jan 28 00:45:35.431156 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Jan 28 00:45:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:45:35.632881 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-e9603d17-eb39-4aba-8928-63b039939ea7 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:45:35.653615 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-e9603d17-eb39-4aba-8928-63b039939ea7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.075784 Jan 28 00:45:35.654089 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Fri Jan 28 00:45:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:46:24.470423 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-73014ca1-22db-4247-a314-02c4a837b9d5 admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:46:24.471990 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-73014ca1-22db-4247-a314-02c4a837b9d5 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002195 Jan 28 00:46:24.472603 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 930 bytes} [Fri Jan 28 00:46:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:46:24.538691 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-10e1ced0-5863-476c-9e78-26a022073b73 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:46:24.559412 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-10e1ced0-5863-476c-9e78-26a022073b73 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.077619 Jan 28 00:46:24.559966 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1291 bytes} [Fri Jan 28 00:46:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:46:24.582988 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-a90e5064-9fb0-4760-bf32-2ed6d603c466 admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:46:24.591911 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-a90e5064-9fb0-4760-bf32-2ed6d603c466 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012551 Jan 28 00:46:24.592473 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1282 bytes} [Fri Jan 28 00:46:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:46:24.604955 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-9dd8099a-bc38-4bb3-826f-b5e78f17429d admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:46:24.613590 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-9dd8099a-bc38-4bb3-826f-b5e78f17429d admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012764 Jan 28 00:46:24.614224 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1285 bytes} [Fri Jan 28 00:46:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:46:24.631482 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-a775433f-87a6-4bb8-9c9f-9a08556e67db admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:46:24.639662 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-a775433f-87a6-4bb8-9c9f-9a08556e67db admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012543 Jan 28 00:46:24.640257 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1285 bytes} [Fri Jan 28 00:46:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:46:24.652387 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-4a4dabcc-8752-4a6c-a2c3-1afde41fa545 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:46:24.660623 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-4a4dabcc-8752-4a6c-a2c3-1afde41fa545 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011742 Jan 28 00:46:24.661393 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1282 bytes} [Fri Jan 28 00:46:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:47:58.184734 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-c3d2f4f5-b32f-4876-a46e-ac71172aa4ae tempest-verify_tempest_config-1448049417 tempest-verify_tempest_config-1448049417-project] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:47:58.186666 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-c3d2f4f5-b32f-4876-a46e-ac71172aa4ae tempest-verify_tempest_config-1448049417 tempest-verify_tempest_config-1448049417-project] 10.222.0.25 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.111576 Jan 28 00:47:58.187203 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 34/69] 10.222.0.25 () {58 vars in 1133 bytes} [Fri Jan 28 00:47:58 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:49:37.075718 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-4a4dabcc-8752-4a6c-a2c3-1afde41fa545 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:49:37.076783 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-4a4dabcc-8752-4a6c-a2c3-1afde41fa545 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Jan 28 00:49:37.077241 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 36/70] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Jan 28 00:49:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:49:37.391639 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-f9386a50-01fa-4324-8e88-624e8481070d admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:49:37.392882 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:49:37.392882 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: warnings.warn(msg) Jan 28 00:49:37.394468 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-f9386a50-01fa-4324-8e88-624e8481070d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:49:37.394911 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-f9386a50-01fa-4324-8e88-624e8481070d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:49:37.395758 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-f9386a50-01fa-4324-8e88-624e8481070d admin admin] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:49:37.396187 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-f9386a50-01fa-4324-8e88-624e8481070d admin admin] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:49:37.436034 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-f9386a50-01fa-4324-8e88-624e8481070d admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.212719 Jan 28 00:49:37.436640 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 35/71] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Jan 28 00:49:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:49:38.810482 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-4a4dabcc-8752-4a6c-a2c3-1afde41fa545 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:49:38.811539 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-4a4dabcc-8752-4a6c-a2c3-1afde41fa545 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jan 28 00:49:38.811947 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 37/72] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Jan 28 00:49:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:49:39.012710 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-50e6ada4-8329-45a7-9595-0d3886879c4e admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:49:39.014283 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:49:39.014283 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: warnings.warn(msg) Jan 28 00:49:39.016189 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-50e6ada4-8329-45a7-9595-0d3886879c4e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:49:39.016700 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-50e6ada4-8329-45a7-9595-0d3886879c4e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:49:39.017684 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-50e6ada4-8329-45a7-9595-0d3886879c4e admin admin] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:49:39.018231 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-50e6ada4-8329-45a7-9595-0d3886879c4e admin admin] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:49:39.043856 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-50e6ada4-8329-45a7-9595-0d3886879c4e admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085329 Jan 28 00:49:39.044546 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 36/73] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Jan 28 00:49:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:49:50.840779 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-4a4dabcc-8752-4a6c-a2c3-1afde41fa545 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:49:50.841779 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-4a4dabcc-8752-4a6c-a2c3-1afde41fa545 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Jan 28 00:49:50.842209 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 38/74] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Jan 28 00:49:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:49:51.044216 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-62c867ff-342f-4934-91d7-c54b41e4d9db admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:49:51.045397 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:49:51.045397 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: warnings.warn(msg) Jan 28 00:49:51.046943 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-62c867ff-342f-4934-91d7-c54b41e4d9db admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:49:51.047411 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-62c867ff-342f-4934-91d7-c54b41e4d9db admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:49:51.048220 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-62c867ff-342f-4934-91d7-c54b41e4d9db admin admin] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:49:51.048654 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-62c867ff-342f-4934-91d7-c54b41e4d9db admin admin] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:49:51.074251 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-62c867ff-342f-4934-91d7-c54b41e4d9db admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084200 Jan 28 00:49:51.074822 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 37/75] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Jan 28 00:49:50 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:49:52.400584 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: DEBUG nova.api.openstack.wsgi [None req-4a4dabcc-8752-4a6c-a2c3-1afde41fa545 admin admin] Calling method '>' {{(pid=113342) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:49:52.401627 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: INFO nova.api.openstack.requestlog [None req-4a4dabcc-8752-4a6c-a2c3-1afde41fa545 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jan 28 00:49:52.402027 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: [pid: 113342|app: 0|req: 39/76] 10.222.0.25 () {56 vars in 1074 bytes} [Fri Jan 28 00:49:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:49:52.610786 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG nova.api.openstack.wsgi [None req-bc6ef4b2-bf6a-402b-8ef2-b912f5f8c50f admin admin] Calling method '>' {{(pid=113341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:49:52.611935 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:49:52.611935 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: warnings.warn(msg) Jan 28 00:49:52.613510 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-bc6ef4b2-bf6a-402b-8ef2-b912f5f8c50f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:49:52.613959 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-bc6ef4b2-bf6a-402b-8ef2-b912f5f8c50f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:49:52.614775 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-bc6ef4b2-bf6a-402b-8ef2-b912f5f8c50f admin admin] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:49:52.615211 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: DEBUG oslo_concurrency.lockutils [None req-bc6ef4b2-bf6a-402b-8ef2-b912f5f8c50f admin admin] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:49:52.637262 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: INFO nova.api.openstack.requestlog [None req-bc6ef4b2-bf6a-402b-8ef2-b912f5f8c50f admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080994 Jan 28 00:49:52.637848 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: [pid: 113341|app: 0|req: 38/77] 10.222.0.25 () {60 vars in 1193 bytes} [Fri Jan 28 00:49:52 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:50:53.442914 dv-cinder-809523-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 28 00:50:53.443826 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: Fri Jan 28 00:50:53 2022 - graceful shutdown triggered... Jan 28 00:50:53.444301 dv-cinder-809523-8-iscsi devstack@n-api.service[113342]: Gracefully killing worker 2 (pid: 113342)... Jan 28 00:50:53.445048 dv-cinder-809523-8-iscsi devstack@n-api.service[113341]: Gracefully killing worker 1 (pid: 113341)... Jan 28 00:50:54.444163 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: worker 1 buried after 1 seconds Jan 28 00:50:54.444163 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: worker 2 buried after 1 seconds Jan 28 00:50:54.444163 dv-cinder-809523-8-iscsi devstack@n-api.service[113340]: goodbye to uWSGI. Jan 28 00:50:54.445813 dv-cinder-809523-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 28 00:50:54.446375 dv-cinder-809523-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 28 00:50:54.449245 dv-cinder-809523-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 28 00:50:54.459446 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 28 00:50:54.461440 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 00:50:54 2022] *** Jan 28 00:50:54.461440 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 00:50:54.461440 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 00:50:54.461440 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: nodename: dv-cinder-809523-8-iscsi Jan 28 00:50:54.461440 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: machine: x86_64 Jan 28 00:50:54.461440 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: clock source: unix Jan 28 00:50:54.461440 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: pcre jit disabled Jan 28 00:50:54.461440 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: detected number of CPU cores: 4 Jan 28 00:50:54.461440 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: current working directory: / Jan 28 00:50:54.461440 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: detected binary path: /usr/bin/uwsgi-core Jan 28 00:50:54.462192 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: your processes number limit is 47680 Jan 28 00:50:54.462192 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: your memory page size is 4096 bytes Jan 28 00:50:54.462192 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: detected max file descriptor number: 2048 Jan 28 00:50:54.462192 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: lock engine: pthread robust mutexes Jan 28 00:50:54.462192 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: thunder lock: enabled Jan 28 00:50:54.462192 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 28 00:50:54.462192 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 00:50:54.514544 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: Python main interpreter initialized at 0x564ad19e69c0 Jan 28 00:50:54.514544 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: python threads support enabled Jan 28 00:50:54.514544 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: your server socket listen backlog is limited to 100 connections Jan 28 00:50:54.514544 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: your mercy for graceful operations on workers is 90 seconds Jan 28 00:50:54.515188 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 00:50:54.515188 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: *** Operational MODE: preforking *** Jan 28 00:50:54.515188 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: *** uWSGI is running in multiple interpreter mode *** Jan 28 00:50:54.515188 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: spawned uWSGI master process (pid: 127844) Jan 28 00:50:54.515424 dv-cinder-809523-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 28 00:50:54.516088 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: spawned uWSGI worker 1 (pid: 127862, cores: 1) Jan 28 00:50:54.516891 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: spawned uWSGI worker 2 (pid: 127863, cores: 1) Jan 28 00:50:54.517181 dv-cinder-809523-8-iscsi devstack@n-api.service[127844]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 00:50:56.542068 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 00:50:56.542068 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: from cryptography.utils import int_from_bytes Jan 28 00:50:56.542778 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 00:50:56.542778 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: from cryptography.utils import int_from_bytes Jan 28 00:50:56.584261 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 00:50:56.584261 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: from cryptography.utils import int_from_bytes Jan 28 00:50:56.585138 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 00:50:56.585138 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: from cryptography.utils import int_from_bytes Jan 28 00:50:59.144141 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 00:50:59.144867 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 00:50:59.144867 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 00:50:59.145886 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 00:50:59.145886 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 00:50:59.145886 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.146274 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.146703 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.146861 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.148495 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.148495 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.148495 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.148495 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.149129 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.149129 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.149679 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.151987 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-809523-8-iscsi {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.151987 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.151987 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.151987 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.151987 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.152659 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.152659 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.152890 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.153408 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.155556 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.155556 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.155556 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.155992 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.156393 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.156969 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.157562 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.157869 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.158407 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.159354 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.159829 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-809523-8-iscsi {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.160207 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.160625 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.161029 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.161484 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.161825 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.162158 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.162499 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.162875 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.163185 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.163556 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.163896 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.164238 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.164608 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.164998 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.165355 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.165773 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.166122 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.166446 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.166807 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.167074 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.167421 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.167765 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.168101 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.168451 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.169250 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.169519 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.169861 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.170383 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.170714 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.171063 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.171390 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.171719 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.172039 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.172361 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.172688 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.173003 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.173337 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.173669 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.174006 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.174326 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.174661 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.175081 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.175356 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.175785 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.176207 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.176572 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.177020 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.177253 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.177530 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.177855 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.178312 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.178584 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.178829 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.179153 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.179498 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.179764 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.180144 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.180407 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.180788 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.181027 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.181329 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.181648 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.182031 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.182268 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.182585 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.182902 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.183223 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.183565 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.183883 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.184204 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.184582 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.185561 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.185904 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.186276 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.186557 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.186877 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.187195 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.187538 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.187871 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.188193 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.188515 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.188856 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.189179 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.189497 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.189831 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.190151 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.190472 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.190957 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.191142 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.191506 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.191774 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.192157 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.192407 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.192726 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.193043 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.193357 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.193674 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.193991 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.194305 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.194616 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.194948 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.195298 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.195677 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.196018 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.196246 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.196578 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.196929 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.197383 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.197624 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.197951 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.198293 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.198670 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.198966 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.199328 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.199641 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.200010 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.200339 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.200666 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.201105 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.201321 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.201654 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.201997 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.202327 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.202654 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.202985 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.203328 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.203662 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.204030 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.204339 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.204662 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.205015 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.205370 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.205727 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.206030 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.206355 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.206692 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.207089 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.207362 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.207674 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.208021 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.208350 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.208677 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.209151 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.209349 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.209677 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.209996 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.210313 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.210692 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.210947 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.211263 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.211614 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.211959 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.212281 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.212623 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.212946 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.213270 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.213591 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.213950 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.214225 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.214553 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.214872 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.215188 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.215549 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.216114 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.216304 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.216561 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.216906 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.217134 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.217461 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.217788 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.218103 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.218428 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.218769 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.219182 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.219437 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.219786 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.220126 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.220443 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.220838 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.221111 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.221441 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.221757 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.222148 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.222464 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.222841 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.223168 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.223520 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.223838 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.224156 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.224471 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.224784 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.225100 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.225438 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.225762 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.226163 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.226393 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.226709 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.227067 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.227406 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.227767 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.228112 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.228440 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.228785 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.229384 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.229926 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.230473 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.231001 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.231905 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.232298 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.232828 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.233266 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.233462 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.235976 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.235976 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.235976 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.235976 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.235976 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.235976 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.235976 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.237578 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.237578 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.237578 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.237578 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.237578 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.238415 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.238415 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.238415 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.238842 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.238981 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.239256 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.239640 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.239928 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.240268 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.240589 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.240922 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.241241 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.241564 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.241906 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.242250 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.242571 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.243069 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.243231 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.243562 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.243884 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.244266 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.244524 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.244841 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.245161 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.245487 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.245807 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.246126 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.246459 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.246762 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.247688 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.247984 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.248300 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.248706 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.249255 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.249831 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.250247 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.250630 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.250918 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.251413 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.251727 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.252062 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.252380 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.252697 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.253023 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.253423 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.253753 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.254075 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.254411 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.254747 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.255074 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.255430 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.255799 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.256211 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.256720 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.256960 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.257227 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.257493 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.258290 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.258290 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.258615 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.258915 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.259105 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.259491 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.259818 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.260138 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.260468 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.260847 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.261410 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.261806 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.262086 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.262516 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.262823 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.263190 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.263616 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.264023 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.264352 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.264676 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.264994 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.265315 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.265634 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.265960 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.266278 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.266605 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.267344 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.267344 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.267935 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.268318 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.268478 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.268758 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.269087 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.269405 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.269767 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.270040 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.270378 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.271140 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.271489 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.271823 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.272122 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.272480 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.272801 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.273156 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.273545 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.273851 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.274174 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.274494 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.274834 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.275153 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.275541 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.275882 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.276211 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.277230 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.277230 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.277544 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.277685 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.277901 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.278415 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.278585 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.278885 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.279639 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.279639 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.280543 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.280543 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.280543 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.280990 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.281133 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.281374 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.281697 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.282015 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.282410 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.283916 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.286743 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.287317 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.287517 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.287876 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.288222 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.288695 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.288923 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.289265 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.289631 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.289951 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.290250 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.290778 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.290943 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.291248 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.291619 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.291943 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.292277 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.292603 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.292934 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.293299 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.293581 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.294441 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.294739 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.295243 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.295598 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.295926 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.296272 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.296604 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.296930 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.297430 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.297595 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.297918 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.298241 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.298792 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.298957 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.299256 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.299620 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.299954 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.300362 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.300532 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 00:50:59.301335 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 00:50:59.301478 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.301478 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.301767 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 00:50:59.301908 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.302063 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 00:50:59.302233 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.302491 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 00:50:59.302637 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.302785 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.302936 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.303097 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.303239 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.303518 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.303685 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.303827 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.303974 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.303974 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.304241 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.304241 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.304657 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.304810 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.304959 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.305100 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.305248 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.305248 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.305512 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.305512 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.305807 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.305948 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.306085 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.306223 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-809523-8-iscsi {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.306369 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.306517 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.306663 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.306810 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.306950 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.307097 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.307243 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.307451 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.307816 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.307959 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.308105 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.308247 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.308387 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.308542 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.308681 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.308681 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.309184 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.309395 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.310049 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.310212 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.310362 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.310503 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.310650 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.310879 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.311109 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.311700 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.311878 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.312029 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.312029 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.312312 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.312480 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.312752 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.312897 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.313048 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.313197 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.313352 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.313518 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.313768 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.313911 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.314058 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-809523-8-iscsi {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.314199 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.314433 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.314657 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.315005 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.315228 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.315442 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.315695 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.315875 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.316031 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.316173 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.316320 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.316478 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.316628 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.316799 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.316947 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.317095 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.317236 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.317401 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.317551 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.317935 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.318107 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.318305 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.318451 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.318637 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.318803 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.318976 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.319410 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.319594 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.319738 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.319905 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.320054 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.320275 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.320426 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.320575 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.320723 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.320872 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.321013 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.321153 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.321299 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.321465 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.321919 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.322110 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.322271 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.322422 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.322568 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.322728 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.323004 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.323159 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.323159 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.323466 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.323608 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.323776 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.324030 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.324177 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.324338 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.324479 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.324618 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.324771 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.324911 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.325342 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.325524 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.325677 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.325818 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.325971 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.326396 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.326585 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.326750 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.326892 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.327032 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.327183 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.327411 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.327563 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.327732 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.328114 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.328363 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.328572 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.328724 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.328866 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.328866 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.329180 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.329550 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.329705 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.329846 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.329993 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.330141 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.330284 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.330439 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.330579 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.330726 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.330874 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.331014 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.331173 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.331355 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.331504 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.331643 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.331808 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.332278 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.332278 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.332655 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.332797 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.332945 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.333231 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.333377 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.333526 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.333680 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.333819 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.333958 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.334227 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.334379 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.334530 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.334672 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.334672 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.334950 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.335090 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.335236 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.335598 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.335742 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.335893 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.336040 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.336180 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.336327 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.336467 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.336613 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.336754 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.336900 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.337048 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.337201 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.337341 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.337480 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.337619 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.337841 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.338001 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.338353 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.338502 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.338650 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.338792 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.338932 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.339072 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.339221 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.339418 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.339765 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.339927 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.340082 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.340259 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.340414 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.340607 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.340771 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.340921 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.341119 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.341403 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.341553 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.341774 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.342033 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.342484 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.342638 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.342808 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.342956 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.343105 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.343443 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.343608 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.343756 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.343911 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.344059 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.344498 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.344672 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.344831 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.344978 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.345125 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.345283 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.345442 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.345713 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.345873 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.346020 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.346176 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.346322 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.346322 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.346625 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.346779 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.346926 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.347081 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.347256 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.347446 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.347602 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.347755 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.347910 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.348065 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.348238 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.348618 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.348817 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.348967 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.349122 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.349280 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.349440 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.349595 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.349956 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.350118 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.350344 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.350496 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.350658 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.350814 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.350969 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.351123 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.351289 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.351456 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.351604 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.351759 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.351912 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.352069 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.352217 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.352408 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.352781 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.352943 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.353099 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 00:50:59.353265 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.353439 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.353690 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.353845 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.353992 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.354138 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.354295 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.354552 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.354717 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.354865 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.355013 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.355159 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.355339 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.355510 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.355659 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.355910 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.356142 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.356876 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.357035 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.357457 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.357613 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.357762 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.357762 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.358096 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.358256 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.358413 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.358745 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.358908 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.359057 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.359203 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.359395 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.359564 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.359712 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.359878 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.360200 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.360355 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.360516 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.360663 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.360812 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.360958 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.361105 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.361251 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.361411 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.361559 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.361559 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.361849 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.362003 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.362158 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.362319 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.362467 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.362613 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.363041 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.363198 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.363437 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.363588 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.363859 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.364035 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.364192 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.364340 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.364496 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.364769 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.364926 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.365074 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.365221 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.365379 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.365528 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.365675 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.365821 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.366104 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.366266 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.366424 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.366573 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.366728 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.366728 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.367024 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.367173 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.367349 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.367510 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.367666 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.367812 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.367960 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.368256 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.368256 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.368570 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.368948 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.369102 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.369250 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.369250 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.369545 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.369699 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.369846 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.369992 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.369992 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.370526 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.370676 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.370823 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.370977 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.370977 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.371255 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.371438 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.371594 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.371749 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.371749 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.372637 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.372802 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.372802 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.373281 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.373555 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.373709 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.373881 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.373881 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.374308 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.374457 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.374457 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.374814 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.375095 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.375095 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.375479 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.375636 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.375794 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.375949 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.375949 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.376371 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.376534 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.376689 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.376836 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.376984 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.377139 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.377139 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.377418 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.377573 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.377728 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.377892 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.377892 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.377892 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.377892 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.377892 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.377892 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.377892 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.378891 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.379245 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.379417 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.379576 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.379576 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.379874 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.380035 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.380035 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.380340 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.380682 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.380682 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.380990 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.381144 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.381292 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.381439 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.381439 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.381737 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.381900 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.381900 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.382191 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.382337 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.382337 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.382614 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.382773 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.382773 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.383054 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.383207 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.383207 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.383840 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.384009 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.384173 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.384431 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.384431 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.384730 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.384890 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.384890 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.385284 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.385438 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.385438 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.385722 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.385878 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.386026 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.386171 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.386171 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.386585 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.386737 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.386737 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.387026 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.387180 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.387359 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.387573 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.387573 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.387863 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.388019 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.388019 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.388307 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.388474 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.388636 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.388812 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.389205 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.389370 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.389526 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.389681 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.389989 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.390160 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.390306 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.390454 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.390801 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.390964 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.391134 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.391354 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.391523 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.391685 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.391831 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.391977 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.392303 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.392712 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.392881 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.393135 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.393289 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.393583 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.393745 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.394043 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.394261 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.394595 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.395111 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.395744 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.395947 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.396346 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.397171 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.397411 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.397545 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.397690 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.397829 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.397966 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.398094 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.398221 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.398357 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.398680 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.398813 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.399429 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.399570 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.399713 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.399851 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.400152 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.400408 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.400610 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.401011 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.401162 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.401479 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.401608 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.401958 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.402197 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.402419 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.402789 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.402931 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.403438 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.403574 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.403901 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.404181 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.404393 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.404698 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.405370 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.406064 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.406272 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.406453 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.406603 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.406942 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.407482 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.407802 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.407973 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.408373 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.408571 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.408851 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.409191 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.409347 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.409748 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.409880 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.410223 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.410399 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.410703 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.411102 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.411252 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.411611 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.411744 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.412076 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.412217 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.412537 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.412814 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.413015 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.413441 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.413572 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.413965 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.414112 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.414379 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.414650 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.414893 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.415213 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.415367 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.415704 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.415901 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.416174 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.416482 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.416644 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.416868 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.417097 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.417780 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.417989 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.418197 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.418401 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.418613 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.418613 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.419559 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.419775 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.419907 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.420043 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.420043 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.420319 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.420508 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.420695 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.420859 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.421023 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.421494 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.421494 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.421893 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.422098 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.422305 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.422305 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.422702 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.422901 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.423092 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.423301 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.423301 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.423645 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.423867 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.424099 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.424510 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.424510 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.425240 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.425558 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.425763 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.425975 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.426189 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.426818 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.427018 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.427232 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.427232 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.427662 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.428111 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.428316 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.428524 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.428736 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.428934 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.429125 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.429330 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.429330 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.429703 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.429908 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.430101 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.430303 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.430494 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.430694 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.430694 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.431079 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.431310 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.431692 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.431902 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.431902 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.432304 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.432502 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.432692 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.432883 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.432883 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.433246 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.433451 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.433643 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.433835 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.433835 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.434195 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.434480 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.434852 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.435221 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.435221 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.435221 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.435929 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.436134 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.436342 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.436699 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.437140 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 00:50:59.437337 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.437337 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.437337 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.437337 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.437337 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.437337 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.437337 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.437337 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.439073 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.439073 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.439073 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.439073 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.439073 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.439073 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.440239 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.440239 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.440239 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.440239 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.440970 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.440970 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.441348 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.441348 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.441854 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.442056 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.442296 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.442621 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.442941 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.443332 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.443656 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.443977 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.444328 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.444653 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.445042 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.445422 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.445775 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.445968 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.446239 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.446557 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.446891 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.447421 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.447644 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.449015 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.449015 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.449015 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.449015 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.450605 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.450605 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.450605 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.451182 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.451590 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.451963 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.452280 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.452611 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.452946 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.453277 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.453607 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.453935 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.454257 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.454583 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.454903 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.455308 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.455740 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.456081 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.456276 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.456503 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.456973 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.457196 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.457688 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.457904 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.458170 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.458378 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.460828 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.460828 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.460828 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.460828 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.460828 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.460828 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.462785 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.462785 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.462785 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.462785 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.462785 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.462785 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.462785 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.464832 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.464832 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.464832 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.464832 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.464832 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.466947 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_db.sqlalchemy.engines [None req-87a2763a-a694-448d-b5f7-cdd048547ac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:50:59.467243 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.467243 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.467243 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.467243 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.467243 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.468128 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.468128 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.468128 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.468550 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.468779 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.468922 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.469232 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.469543 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.469907 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.470227 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.470613 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.470934 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.471329 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.471624 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.471950 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.472281 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.472608 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.472930 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.473262 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.473592 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.473921 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.474242 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.474562 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.474902 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.475230 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.475698 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.475921 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.476260 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.476602 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.476951 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.477281 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.477563 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.477889 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.478208 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.478532 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.478859 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.479185 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.479538 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.479865 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.480193 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.480535 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.480840 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.481191 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.481816 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.482395 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.482665 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.482989 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.483341 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.483665 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.483998 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.484322 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.484852 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.485174 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.485555 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.485896 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.486202 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.486545 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.486863 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.487199 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.487552 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.488035 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.488358 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.488645 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.488973 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.489291 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.489697 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.489932 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.490272 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.490677 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.490924 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.491224 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.492886 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.493220 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.493619 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.494123 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.494370 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.494762 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.495206 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.495568 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.495901 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.496251 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.496592 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.497607 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.497948 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.498554 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.498902 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.499251 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.499622 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.499959 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.500317 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.500839 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.501465 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.502064 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.502813 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.502813 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.503063 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.503423 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.503764 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.504110 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.504460 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.504787 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.505109 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.505436 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.505759 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.506085 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.506430 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.506751 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.507081 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.507507 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.507872 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.508082 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.508554 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.508740 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.509061 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.509404 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.509736 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.510073 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.510413 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.510742 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.511082 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.511469 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.511789 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.512110 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.512490 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.513599 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.514159 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.514511 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.514866 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.515217 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.515580 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.515938 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.516339 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.516610 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.516949 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.517290 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.517997 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.518196 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.518556 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.518842 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.519163 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.519509 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.519837 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.520160 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.520503 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.520834 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.521179 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.521502 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.521842 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.522165 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.522486 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.522808 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.523127 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.523513 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.523838 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.524188 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.524524 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.524864 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.525208 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.525535 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.525876 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.526216 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.526545 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.526878 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.527211 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.527571 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.527912 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.528773 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.529294 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.529862 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.530202 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.530540 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.531132 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.531507 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.531841 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.532177 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.532510 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.532685 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.context [None req-87a2763a-a694-448d-b5f7-cdd048547ac1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f15678a-aa46-4c92-970a-a19695f4d8dc(cell1) {{(pid=127862) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 00:50:59.532860 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.533156 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.533486 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.533807 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.534134 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.534462 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.534809 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.535148 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.535549 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.535906 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.536246 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.536572 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.536905 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.537119 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-87a2763a-a694-448d-b5f7-cdd048547ac1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:50:59.537228 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.537603 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.537935 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.538259 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.538586 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.538772 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-87a2763a-a694-448d-b5f7-cdd048547ac1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:50:59.538916 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.539243 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.539599 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.539694 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-87a2763a-a694-448d-b5f7-cdd048547ac1 None None] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:50:59.539928 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.540261 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.540596 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.540918 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.541364 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.541571 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.541720 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-87a2763a-a694-448d-b5f7-cdd048547ac1 None None] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:50:59.541907 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.542248 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.542717 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.542925 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.543296 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.543610 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.544615 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.545591 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.546129 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.546299 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.546607 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.546949 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.547333 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.547649 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.548058 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.548658 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.548880 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.549329 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.549506 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.549669 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.550071 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.550318 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.550646 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.551110 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.551469 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.551919 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.552361 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.552607 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.552951 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.553297 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.553632 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.553949 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.554289 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.554611 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.554932 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.555093 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_db.sqlalchemy.engines [None req-87a2763a-a694-448d-b5f7-cdd048547ac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:50:59.555255 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.555601 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.555923 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.556070 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_db.sqlalchemy.engines [None req-87a2763a-a694-448d-b5f7-cdd048547ac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:50:59.556245 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.556574 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.556902 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.557222 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.557544 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.557854 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.558210 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.558745 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.558919 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.559143 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.559552 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.559974 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.560552 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.560895 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.561217 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.561555 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.561880 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.562412 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.562577 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.562854 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.563373 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.563533 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.563846 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.564191 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.564516 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.564835 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.565174 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.565501 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.565841 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.566173 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.566501 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.566868 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.567200 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.567874 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.568224 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.568564 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.568922 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.569268 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.569619 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.569909 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.570229 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.570574 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.570901 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.571227 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.571579 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.571903 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.572228 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.572556 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.572873 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.573199 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.573524 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.573848 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.574173 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.574505 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.574864 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.575319 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.575912 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.576266 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.576600 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.576930 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.577257 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.577583 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.577912 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.578242 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.578593 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.579036 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.579238 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.579748 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.580035 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.580372 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.580729 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.581042 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.581382 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.581722 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.582050 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.582387 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.582722 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.583053 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.583437 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.583785 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.584127 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.584447 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.584768 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.585088 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.585411 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.585757 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.586107 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.586438 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.586777 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.587103 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.587464 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.587791 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.588132 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.588468 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.588805 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.589344 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.589947 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.591087 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.591641 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.592217 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.592566 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.592961 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.593230 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.593855 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.594343 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.594677 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.595025 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.595387 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.595734 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.596069 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.596402 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.596749 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.597079 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.597619 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.598096 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.598700 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.600225 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.600225 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.600502 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.600865 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.601217 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.601592 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.602253 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.602858 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.603559 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.604338 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.604818 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.605205 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.605538 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 00:50:59.605801 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 00:50:59.632211 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_db.sqlalchemy.engines [None req-16275c73-dce1-4449-8938-571e6424a645 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:50:59.698804 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.context [None req-16275c73-dce1-4449-8938-571e6424a645 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1f15678a-aa46-4c92-970a-a19695f4d8dc(cell1) {{(pid=127863) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 00:50:59.704253 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-16275c73-dce1-4449-8938-571e6424a645 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:50:59.706071 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-16275c73-dce1-4449-8938-571e6424a645 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:50:59.707129 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-16275c73-dce1-4449-8938-571e6424a645 None None] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:50:59.709249 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-16275c73-dce1-4449-8938-571e6424a645 None None] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:50:59.723343 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_db.sqlalchemy.engines [None req-16275c73-dce1-4449-8938-571e6424a645 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:50:59.724884 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_db.sqlalchemy.engines [None req-16275c73-dce1-4449-8938-571e6424a645 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:50:59.743211 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_db.sqlalchemy.engines [None req-87a2763a-a694-448d-b5f7-cdd048547ac1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:50:59.906777 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_db.sqlalchemy.engines [None req-16275c73-dce1-4449-8938-571e6424a645 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 00:51:00.090192 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: WARNING keystonemiddleware.auth_token [None req-87a2763a-a694-448d-b5f7-cdd048547ac1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 00:51:00.097809 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: WARNING keystonemiddleware.auth_token [None req-87a2763a-a694-448d-b5f7-cdd048547ac1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 00:51:00.262006 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: WARNING keystonemiddleware.auth_token [None req-16275c73-dce1-4449-8938-571e6424a645 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 00:51:00.270197 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: WARNING keystonemiddleware.auth_token [None req-16275c73-dce1-4449-8938-571e6424a645 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 00:51:00.510080 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: WARNING keystonemiddleware.auth_token [None req-87a2763a-a694-448d-b5f7-cdd048547ac1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 00:51:00.515853 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: WARNING keystonemiddleware.auth_token [None req-87a2763a-a694-448d-b5f7-cdd048547ac1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 00:51:00.521440 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564ad19e69c0 pid: 127862 (default app) Jan 28 00:51:00.634976 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: WARNING keystonemiddleware.auth_token [None req-16275c73-dce1-4449-8938-571e6424a645 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 00:51:00.644254 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: WARNING keystonemiddleware.auth_token [None req-16275c73-dce1-4449-8938-571e6424a645 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 00:51:00.649839 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564ad19e69c0 pid: 127863 (default app) Jan 28 00:51:39.044172 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-b1aa9b1e-35ba-42a3-8596-6a323beb528b tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Action: 'create', calling method: .version_select at 0x7fbbc4281c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-329779147"}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:51:39.165520 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-18d783f1-6e8c-4aa5-a0f2-c4ad6e98ef78 tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] Action: 'create', calling method: .version_select at 0x7fbbc4281c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-248698661", "metadata": {"Type": "work"}}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:51:39.168777 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-18d783f1-6e8c-4aa5-a0f2-c4ad6e98ef78 tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:51:39.169763 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-18d783f1-6e8c-4aa5-a0f2-c4ad6e98ef78 tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.669752 Jan 28 00:51:39.170496 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1155 bytes} [Fri Jan 28 00:51:37 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1674 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 00:51:39.175111 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7d373644-eb62-449d-abf3-889b34275201 tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] Calling method '.version_select at 0x7fbbc4166820>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:40.473096 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7d373644-eb62-449d-abf3-889b34275201 tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/a1035850-18f6-48e1-9cf9-1795b5509f17" status: 200 len: 351 microversion: 2.1 time: 1.301425 Jan 28 00:51:40.473803 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 2/2] 10.222.0.25 () {58 vars in 1244 bytes} [Fri Jan 28 00:51:39 2022] GET /compute/v2.1/os-volumes/a1035850-18f6-48e1-9cf9-1795b5509f17 => generated 351 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:40.480334 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e7314bd8-f7b5-47af-9f9b-71669cbc902c tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] Action: 'create', calling method: .version_select at 0x7fbbc4a6c550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1301465146", "metadata": {"Type": "work"}}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:51:40.481620 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e7314bd8-f7b5-47af-9f9b-71669cbc902c tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:51:40.492880 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e7314bd8-f7b5-47af-9f9b-71669cbc902c tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017192 Jan 28 00:51:40.502879 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 3/3] 10.222.0.25 () {60 vars in 1155 bytes} [Fri Jan 28 00:51:40 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 00:51:40.722112 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-73ecef0b-ab37-47d7-a482-66766f76a902 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-393059259", "imageRef": "7fe09c59-2ff9-4639-b39d-9a474e83ad91", "flavorRef": "452", "networks": [{"uuid": "91062910-ec9a-477b-8363-c361be88ddaf"}]}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:51:40.882919 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-b1aa9b1e-35ba-42a3-8596-6a323beb528b tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.931869 Jan 28 00:51:40.884448 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 1/4] 10.222.0.25 () {60 vars in 1154 bytes} [Fri Jan 28 00:51:36 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3934 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jan 28 00:51:40.895342 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ae531bcb-9986-48fb-9d07-471a83aefca6 tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] Action: 'create', calling method: .version_select at 0x7fbbc416a790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-475816506", "metadata": {"Type": "work"}}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:51:40.896831 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ae531bcb-9986-48fb-9d07-471a83aefca6 tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:51:40.897753 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ae531bcb-9986-48fb-9d07-471a83aefca6 tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012589 Jan 28 00:51:40.900372 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 2/5] 10.222.0.25 () {60 vars in 1155 bytes} [Fri Jan 28 00:51:40 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 00:51:40.916256 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-5d8b943c-22ed-4575-9978-cea47dd51123 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Calling method '.version_select at 0x7fbbc4a6a3a0>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:40.948189 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.network.neutron [None req-73ecef0b-ab37-47d7-a482-66766f76a902 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] validate_networks() for [('91062910-ec9a-477b-8363-c361be88ddaf', None, None, None, None, None)] {{(pid=127863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:51:41.129437 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-5d8b943c-22ed-4575-9978-cea47dd51123 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/d99f437a-7d93-4677-8dfe-02fce7156d47" status: 200 len: 344 microversion: 2.1 time: 0.227681 Jan 28 00:51:41.130008 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 3/6] 10.222.0.25 () {58 vars in 1244 bytes} [Fri Jan 28 00:51:40 2022] GET /compute/v2.1/os-volumes/d99f437a-7d93-4677-8dfe-02fce7156d47 => generated 344 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:41.139371 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ff02b3ed-df66-403a-877f-1ec23bec772c tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] Calling method '.version_select at 0x7fbbc40e6040>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:41.232636 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-ff02b3ed-df66-403a-877f-1ec23bec772c tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] HTTP exception thrown: Volume tempest-invalid-43574056 could not be found. Jan 28 00:51:41.233376 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ff02b3ed-df66-403a-877f-1ec23bec772c tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] Returning 404 to user: Volume tempest-invalid-43574056 could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:51:41.234422 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ff02b3ed-df66-403a-877f-1ec23bec772c tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-43574056" status: 404 len: 97 microversion: 2.1 time: 0.103505 Jan 28 00:51:41.238863 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1211 bytes} [Fri Jan 28 00:51:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-43574056 => generated 97 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 28 00:51:41.245876 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-0bc9d922-3408-4faa-8677-6f2a17a97b8b tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005315 Jan 28 00:51:41.247633 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 5/8] 10.222.0.25 () {58 vars in 1139 bytes} [Fri Jan 28 00:51:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 28 00:51:41.257041 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4734941e-2ab9-400e-9e00-7bb77d09591f tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004016 Jan 28 00:51:41.259609 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 6/9] 10.222.0.25 () {58 vars in 1136 bytes} [Fri Jan 28 00:51:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 28 00:51:41.270043 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-aba93452-06fe-49bd-bc59-b17a5ee16f0e tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] Calling method '.version_select at 0x7fbbc414ba60>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:41.324259 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-aba93452-06fe-49bd-bc59-b17a5ee16f0e tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] HTTP exception thrown: Volume 11719a6f-2592-4642-b9fa-9c583eaed060 could not be found. Jan 28 00:51:41.326012 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-aba93452-06fe-49bd-bc59-b17a5ee16f0e tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] Returning 404 to user: Volume 11719a6f-2592-4642-b9fa-9c583eaed060 could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:51:41.327120 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-aba93452-06fe-49bd-bc59-b17a5ee16f0e tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/11719a6f-2592-4642-b9fa-9c583eaed060" status: 404 len: 109 microversion: 2.1 time: 0.061854 Jan 28 00:51:41.327705 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 7/10] 10.222.0.25 () {58 vars in 1247 bytes} [Fri Jan 28 00:51:41 2022] DELETE /compute/v2.1/os-volumes/11719a6f-2592-4642-b9fa-9c583eaed060 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 00:51:41.344370 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-05b5813e-3efe-467f-a145-69df457852f4 tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] Calling method '.version_select at 0x7fbbc40e6040>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:41.417960 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-05b5813e-3efe-467f-a145-69df457852f4 tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] HTTP exception thrown: Volume 2b5b9629-fa76-477f-bc63-e375bb75aa07 could not be found. Jan 28 00:51:41.418645 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-05b5813e-3efe-467f-a145-69df457852f4 tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] Returning 404 to user: Volume 2b5b9629-fa76-477f-bc63-e375bb75aa07 could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:51:41.421184 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-05b5813e-3efe-467f-a145-69df457852f4 tempest-VolumesNegativeTest-630761941 tempest-VolumesNegativeTest-630761941-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/2b5b9629-fa76-477f-bc63-e375bb75aa07" status: 404 len: 109 microversion: 2.1 time: 0.085322 Jan 28 00:51:41.421853 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 8/11] 10.222.0.25 () {58 vars in 1244 bytes} [Fri Jan 28 00:51:41 2022] GET /compute/v2.1/os-volumes/2b5b9629-fa76-477f-bc63-e375bb75aa07 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:51:42.148487 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-77c78146-5879-4d45-851b-d2720b8b1522 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Calling method '.version_select at 0x7fbbc414b8b0>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:42.271930 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-77c78146-5879-4d45-851b-d2720b8b1522 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/d99f437a-7d93-4677-8dfe-02fce7156d47" status: 200 len: 345 microversion: 2.1 time: 0.127049 Jan 28 00:51:42.272796 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 9/12] 10.222.0.25 () {58 vars in 1244 bytes} [Fri Jan 28 00:51:42 2022] GET /compute/v2.1/os-volumes/d99f437a-7d93-4677-8dfe-02fce7156d47 => generated 345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:51:42.291903 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-501aef08-8ea9-4196-9f8d-34a9921cf31d tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Action: 'create', calling method: .version_select at 0x7fbbc40e6280>, body: {"snapshot": {"volume_id": "d99f437a-7d93-4677-8dfe-02fce7156d47", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1126384997"}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:51:42.692542 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-501aef08-8ea9-4196-9f8d-34a9921cf31d tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.407105 Jan 28 00:51:42.697229 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 10/13] 10.222.0.25 () {60 vars in 1161 bytes} [Fri Jan 28 00:51:42 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:42.701914 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-8d895a53-5317-4fdb-aaa4-4ea9057dc0f6 tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] Calling method '.version_select at 0x7fbbc414bd30>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:42.844149 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-8d895a53-5317-4fdb-aaa4-4ea9057dc0f6 tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e9364c4b-4115-40a5-8a8e-4a4852e52d40" status: 200 len: 351 microversion: 2.1 time: 0.145879 Jan 28 00:51:42.851609 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 11/14] 10.222.0.25 () {58 vars in 1244 bytes} [Fri Jan 28 00:51:42 2022] GET /compute/v2.1/os-volumes/e9364c4b-4115-40a5-8a8e-4a4852e52d40 => generated 351 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:42.856761 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-8ba36672-7046-476d-8f2d-6d36489148af tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Calling method '.version_select at 0x7fbbc40e6670>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:43.124925 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-8ba36672-7046-476d-8f2d-6d36489148af tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/09560a0a-af17-42a4-8132-613d2f1cd557" status: 200 len: 287 microversion: 2.1 time: 0.278757 Jan 28 00:51:43.125513 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 12/15] 10.222.0.25 () {58 vars in 1250 bytes} [Fri Jan 28 00:51:42 2022] GET /compute/v2.1/os-snapshots/09560a0a-af17-42a4-8132-613d2f1cd557 => generated 287 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:43.137016 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-6a8f0a90-fcb8-4a85-a945-c3fdde8d3cf2 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Calling method '.version_select at 0x7fbbc40e6700>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:43.162059 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-73ecef0b-ab37-47d7-a482-66766f76a902 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Flavor limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:51:43.163013 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-73ecef0b-ab37-47d7-a482-66766f76a902 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Image limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:51:43.163542 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-73ecef0b-ab37-47d7-a482-66766f76a902 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Flavor pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:51:43.163966 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-73ecef0b-ab37-47d7-a482-66766f76a902 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Image pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:51:43.164391 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-73ecef0b-ab37-47d7-a482-66766f76a902 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:51:43.205318 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-73ecef0b-ab37-47d7-a482-66766f76a902 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:43.208649 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-73ecef0b-ab37-47d7-a482-66766f76a902 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:43.209766 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-73ecef0b-ab37-47d7-a482-66766f76a902 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:43.211494 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-73ecef0b-ab37-47d7-a482-66766f76a902 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:43.272049 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-6a8f0a90-fcb8-4a85-a945-c3fdde8d3cf2 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.139302 Jan 28 00:51:43.273413 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 13/16] 10.222.0.25 () {58 vars in 1139 bytes} [Fri Jan 28 00:51:43 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:43.283790 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-73ecef0b-ab37-47d7-a482-66766f76a902 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Getting quotas for project 3084946f74c3454cb750fe1c88cf6092. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:51:43.287315 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f87bf10a-abab-4276-92df-9beffb78a6af tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Calling method '.version_select at 0x7fbbc40e6dc0>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:43.300015 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-73ecef0b-ab37-47d7-a482-66766f76a902 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Getting quotas for user a06525ba694c4151a57ebb700ff967f9 and project 3084946f74c3454cb750fe1c88cf6092. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:51:43.387203 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-73ecef0b-ab37-47d7-a482-66766f76a902 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Going to run 1 instances... {{(pid=127863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:51:43.396563 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-73ecef0b-ab37-47d7-a482-66766f76a902 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fe09c59-2ff9-4639-b39d-9a474e83ad91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:51:43.463114 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f87bf10a-abab-4276-92df-9beffb78a6af tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/09560a0a-af17-42a4-8132-613d2f1cd557" status: 200 len: 287 microversion: 2.1 time: 0.182333 Jan 28 00:51:43.463860 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 14/17] 10.222.0.25 () {58 vars in 1250 bytes} [Fri Jan 28 00:51:43 2022] GET /compute/v2.1/os-snapshots/09560a0a-af17-42a4-8132-613d2f1cd557 => generated 287 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:51:43.584820 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-73ecef0b-ab37-47d7-a482-66766f76a902 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.079452 Jan 28 00:51:43.597337 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-b0d00562-ecbd-422c-98b6-494122e06c8b tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:43.598113 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-b0d00562-ecbd-422c-98b6-494122e06c8b tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:51:43.600469 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 4/18] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 00:51:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 00:51:44.116974 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-b0d00562-ecbd-422c-98b6-494122e06c8b tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:51:44.136892 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-b0d00562-ecbd-422c-98b6-494122e06c8b tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1214 microversion: 2.1 time: 0.543006 Jan 28 00:51:44.138637 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 15/19] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:51:43 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1214 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:51:44.476135 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5f5918c5-9b53-4d69-b31b-0e43dfe03044 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Calling method '.version_select at 0x7fbbc37f3040>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:44.964359 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5f5918c5-9b53-4d69-b31b-0e43dfe03044 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/09560a0a-af17-42a4-8132-613d2f1cd557" status: 200 len: 287 microversion: 2.1 time: 0.491406 Jan 28 00:51:44.966075 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 5/20] 10.222.0.25 () {58 vars in 1250 bytes} [Fri Jan 28 00:51:44 2022] GET /compute/v2.1/os-snapshots/09560a0a-af17-42a4-8132-613d2f1cd557 => generated 287 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:45.158990 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-bb8fb3ec-f91a-4d2b-b213-e74c6d3c6948 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:45.160453 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-bb8fb3ec-f91a-4d2b-b213-e74c6d3c6948 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:51:45.330176 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-bb8fb3ec-f91a-4d2b-b213-e74c6d3c6948 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:51:45.337920 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-bb8fb3ec-f91a-4d2b-b213-e74c6d3c6948 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1214 microversion: 2.1 time: 0.183651 Jan 28 00:51:45.343610 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 16/21] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:51:45 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1214 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:51:45.747187 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-849456f3-d219-418a-ab30-c4781eac256b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'create', calling method: .version_select at 0x7fbbc37f3ca0>, body: {"keypair": {"name": "tempest-keypair-1847242233"}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:51:45.826966 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-849456f3-d219-418a-ab30-c4781eac256b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Getting quotas for project 6db84ca9b72548269154e343a33767b4. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:51:45.838596 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-849456f3-d219-418a-ab30-c4781eac256b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Getting quotas for user ec5dffa23e574a9e97867c93c033fcdc and project 6db84ca9b72548269154e343a33767b4. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:51:45.977699 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-e710eb0d-5b59-4db3-b7d1-d0ec47bab2a0 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Calling method '.version_select at 0x7fbbc40b5b80>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:46.043677 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-e710eb0d-5b59-4db3-b7d1-d0ec47bab2a0 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/09560a0a-af17-42a4-8132-613d2f1cd557" status: 200 len: 287 microversion: 2.1 time: 0.068890 Jan 28 00:51:46.043677 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 17/22] 10.222.0.25 () {58 vars in 1250 bytes} [Fri Jan 28 00:51:45 2022] GET /compute/v2.1/os-snapshots/09560a0a-af17-42a4-8132-613d2f1cd557 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:51:46.375503 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3ef82bcd-e43e-4542-85f0-01bdc73ccded tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:46.378256 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3ef82bcd-e43e-4542-85f0-01bdc73ccded tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:51:46.630739 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3ef82bcd-e43e-4542-85f0-01bdc73ccded tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:51:46.640992 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3ef82bcd-e43e-4542-85f0-01bdc73ccded tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1214 microversion: 2.1 time: 0.271528 Jan 28 00:51:46.641919 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 18/23] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:51:46 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1214 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:51:46.848903 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-849456f3-d219-418a-ab30-c4781eac256b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Getting quotas for project 6db84ca9b72548269154e343a33767b4. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:51:46.858899 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-849456f3-d219-418a-ab30-c4781eac256b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Getting quotas for user ec5dffa23e574a9e97867c93c033fcdc and project 6db84ca9b72548269154e343a33767b4. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:51:46.894963 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-849456f3-d219-418a-ab30-c4781eac256b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.581096 Jan 28 00:51:46.899016 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 6/24] 10.222.0.25 () {62 vars in 1198 bytes} [Fri Jan 28 00:51:45 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1586 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 28 00:51:47.054142 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f68b3a79-4076-4cc6-b4a4-e2706ed77d3d tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Calling method '.version_select at 0x7fbbc4a6a280>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:47.122133 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f68b3a79-4076-4cc6-b4a4-e2706ed77d3d tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/09560a0a-af17-42a4-8132-613d2f1cd557" status: 200 len: 288 microversion: 2.1 time: 0.056778 Jan 28 00:51:47.122133 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 19/25] 10.222.0.25 () {58 vars in 1250 bytes} [Fri Jan 28 00:51:47 2022] GET /compute/v2.1/os-snapshots/09560a0a-af17-42a4-8132-613d2f1cd557 => generated 288 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:47.141779 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-9f99ee10-7d07-4b30-99fc-34b9608c7349 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Calling method '.version_select at 0x7fbbc3802820>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:47.269608 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-81c111a6-eb91-42aa-8f02-32a9bf82877d tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] Calling method '.version_select at 0x7fbbc40c1940>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:47.303690 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-9f99ee10-7d07-4b30-99fc-34b9608c7349 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/09560a0a-af17-42a4-8132-613d2f1cd557" status: 202 len: 0 microversion: 2.1 time: 0.182402 Jan 28 00:51:47.306925 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 7/26] 10.222.0.25 () {58 vars in 1253 bytes} [Fri Jan 28 00:51:47 2022] DELETE /compute/v2.1/os-snapshots/09560a0a-af17-42a4-8132-613d2f1cd557 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:51:47.324243 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-fb440e6c-2db9-4e59-b7ed-e55e8f3deeff tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Calling method '.version_select at 0x7fbbc27970d0>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:47.408939 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-fb440e6c-2db9-4e59-b7ed-e55e8f3deeff tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/09560a0a-af17-42a4-8132-613d2f1cd557" status: 200 len: 287 microversion: 2.1 time: 0.096533 Jan 28 00:51:47.411398 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 8/27] 10.222.0.25 () {58 vars in 1250 bytes} [Fri Jan 28 00:51:47 2022] GET /compute/v2.1/os-snapshots/09560a0a-af17-42a4-8132-613d2f1cd557 => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:51:47.464643 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-81c111a6-eb91-42aa-8f02-32a9bf82877d tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/6c86151a-241a-4d39-87de-20a9ed226767" status: 200 len: 350 microversion: 2.1 time: 0.205203 Jan 28 00:51:47.495996 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 20/28] 10.222.0.25 () {58 vars in 1244 bytes} [Fri Jan 28 00:51:47 2022] GET /compute/v2.1/os-volumes/6c86151a-241a-4d39-87de-20a9ed226767 => generated 350 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:47.500577 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b52b906c-5da0-4ebc-ad28-eb13b5602c24 tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] Calling method '.version_select at 0x7fbbc2797a60>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:47.662073 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-472f515e-9faf-43d6-95c7-ae5efef01f9f tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:47.662954 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-472f515e-9faf-43d6-95c7-ae5efef01f9f tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:51:47.690792 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-472f515e-9faf-43d6-95c7-ae5efef01f9f tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:47.691309 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-472f515e-9faf-43d6-95c7-ae5efef01f9f tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:47.693813 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-472f515e-9faf-43d6-95c7-ae5efef01f9f tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:47.694882 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-472f515e-9faf-43d6-95c7-ae5efef01f9f tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:47.846689 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b52b906c-5da0-4ebc-ad28-eb13b5602c24 tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.357114 Jan 28 00:51:47.865726 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 9/29] 10.222.0.25 () {58 vars in 1133 bytes} [Fri Jan 28 00:51:47 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:51:47.892050 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-dbd1ab00-14b0-4af2-96d3-172af323d0c4 tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] Calling method '.version_select at 0x7fbbc3802af0>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:48.157910 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-dbd1ab00-14b0-4af2-96d3-172af323d0c4 tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.281586 Jan 28 00:51:48.172933 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 10/30] 10.222.0.25 () {58 vars in 1148 bytes} [Fri Jan 28 00:51:47 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:48.205345 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-9840dbc3-6441-441d-81f2-fa53aaf4f657 tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] Calling method '.version_select at 0x7fbbc27a03a0>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:48.228362 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-472f515e-9faf-43d6-95c7-ae5efef01f9f tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:51:48.266534 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-472f515e-9faf-43d6-95c7-ae5efef01f9f tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1266 microversion: 2.1 time: 0.609061 Jan 28 00:51:48.280252 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 21/31] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:51:47 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1266 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:51:48.401956 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-9840dbc3-6441-441d-81f2-fa53aaf4f657 tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.225662 Jan 28 00:51:48.414222 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 11/32] 10.222.0.25 () {58 vars in 1133 bytes} [Fri Jan 28 00:51:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:51:48.422287 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3e74d1f4-1da2-430d-8420-f2f00c2e583b tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Calling method '.version_select at 0x7fbbc27a3310>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:48.422528 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-79f955b4-eb66-4cb0-b9b4-92e2599a5164 tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] Calling method '.version_select at 0x7fbbc403c160>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:48.490836 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-3e74d1f4-1da2-430d-8420-f2f00c2e583b tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] HTTP exception thrown: Snapshot 09560a0a-af17-42a4-8132-613d2f1cd557 could not be found. Jan 28 00:51:48.491627 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3e74d1f4-1da2-430d-8420-f2f00c2e583b tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Returning 404 to user: Snapshot 09560a0a-af17-42a4-8132-613d2f1cd557 could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:51:48.493587 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3e74d1f4-1da2-430d-8420-f2f00c2e583b tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/09560a0a-af17-42a4-8132-613d2f1cd557" status: 404 len: 111 microversion: 2.1 time: 0.074148 Jan 28 00:51:48.494498 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 12/33] 10.222.0.25 () {58 vars in 1250 bytes} [Fri Jan 28 00:51:48 2022] GET /compute/v2.1/os-snapshots/09560a0a-af17-42a4-8132-613d2f1cd557 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:51:48.515429 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-89827a1d-25da-40e5-aaee-16c5d33587b9 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Calling method '.version_select at 0x7fbbc27a09d0>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:48.683249 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-89827a1d-25da-40e5-aaee-16c5d33587b9 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/d99f437a-7d93-4677-8dfe-02fce7156d47" status: 202 len: 0 microversion: 2.1 time: 0.184049 Jan 28 00:51:48.684930 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 13/34] 10.222.0.25 () {58 vars in 1247 bytes} [Fri Jan 28 00:51:48 2022] DELETE /compute/v2.1/os-volumes/d99f437a-7d93-4677-8dfe-02fce7156d47 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:51:48.697862 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c5534e52-077a-4138-aee4-d3abb4fcf1bb tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Calling method '.version_select at 0x7fbbc27a0d30>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:48.835791 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c5534e52-077a-4138-aee4-d3abb4fcf1bb tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/d99f437a-7d93-4677-8dfe-02fce7156d47" status: 200 len: 344 microversion: 2.1 time: 0.145662 Jan 28 00:51:48.837626 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 14/35] 10.222.0.25 () {58 vars in 1244 bytes} [Fri Jan 28 00:51:48 2022] GET /compute/v2.1/os-volumes/d99f437a-7d93-4677-8dfe-02fce7156d47 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:51:48.871730 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-79f955b4-eb66-4cb0-b9b4-92e2599a5164 tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.452512 Jan 28 00:51:48.872794 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 22/36] 10.222.0.25 () {58 vars in 1166 bytes} [Fri Jan 28 00:51:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:48.891082 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-42536bbf-572a-4700-b168-1d311e07592f tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] Calling method '.version_select at 0x7fbbc27a0af0>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:49.111009 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-42536bbf-572a-4700-b168-1d311e07592f tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.224138 Jan 28 00:51:49.112311 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 15/37] 10.222.0.25 () {58 vars in 1169 bytes} [Fri Jan 28 00:51:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:51:49.141799 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3a19dc78-2c53-43c4-a92d-743a0f2a0345 tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] Calling method '.version_select at 0x7fbbc3fd3dc0>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:49.284716 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3ff966e8-20f3-477b-892d-3671b4147072 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:49.285754 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-3ff966e8-20f3-477b-892d-3671b4147072 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:51:49.330858 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3ff966e8-20f3-477b-892d-3671b4147072 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:49.335443 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3ff966e8-20f3-477b-892d-3671b4147072 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:49.338960 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3ff966e8-20f3-477b-892d-3671b4147072 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:49.339788 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3ff966e8-20f3-477b-892d-3671b4147072 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:49.470618 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3a19dc78-2c53-43c4-a92d-743a0f2a0345 tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.342030 Jan 28 00:51:49.471598 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 23/38] 10.222.0.25 () {58 vars in 1154 bytes} [Fri Jan 28 00:51:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:51:49.488933 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f874d7a1-ad05-4d8d-aedc-14c64fc495d3 tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] Calling method '.version_select at 0x7fbbc3fe3dc0>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:49.799353 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f874d7a1-ad05-4d8d-aedc-14c64fc495d3 tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.314717 Jan 28 00:51:49.799956 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 24/39] 10.222.0.25 () {58 vars in 1187 bytes} [Fri Jan 28 00:51:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:51:49.817358 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-bccf74c6-b2fd-4d9d-b562-1081a91fb2b9 tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] Calling method '.version_select at 0x7fbbc403c550>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:50.146405 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-3ff966e8-20f3-477b-892d-3671b4147072 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:51:50.230038 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3ff966e8-20f3-477b-892d-3671b4147072 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1272 microversion: 2.1 time: 0.948367 Jan 28 00:51:50.233354 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 16/40] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:51:49 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1272 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:51:50.251902 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-bccf74c6-b2fd-4d9d-b562-1081a91fb2b9 tempest-VolumesTestJSON-1801993457 tempest-VolumesTestJSON-1801993457-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.439700 Jan 28 00:51:50.252613 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 25/41] 10.222.0.25 () {58 vars in 1154 bytes} [Fri Jan 28 00:51:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:51:50.252966 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ac84360d-900c-485a-8db5-f903f85debd2 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Calling method '.version_select at 0x7fbbc26dab80>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:50.321164 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-ac84360d-900c-485a-8db5-f903f85debd2 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] HTTP exception thrown: Volume d99f437a-7d93-4677-8dfe-02fce7156d47 could not be found. Jan 28 00:51:50.322676 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ac84360d-900c-485a-8db5-f903f85debd2 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Returning 404 to user: Volume d99f437a-7d93-4677-8dfe-02fce7156d47 could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:51:50.323885 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ac84360d-900c-485a-8db5-f903f85debd2 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/d99f437a-7d93-4677-8dfe-02fce7156d47" status: 404 len: 109 microversion: 2.1 time: 0.088658 Jan 28 00:51:50.324642 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 17/42] 10.222.0.25 () {58 vars in 1244 bytes} [Fri Jan 28 00:51:50 2022] GET /compute/v2.1/os-volumes/d99f437a-7d93-4677-8dfe-02fce7156d47 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:51:50.340806 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ee2a013f-6c8b-4199-81db-9e60c4abb2e2 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Calling method '.version_select at 0x7fbbc3ff8700>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:50.581019 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-ee2a013f-6c8b-4199-81db-9e60c4abb2e2 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] HTTP exception thrown: Volume d99f437a-7d93-4677-8dfe-02fce7156d47 could not be found. Jan 28 00:51:50.581891 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ee2a013f-6c8b-4199-81db-9e60c4abb2e2 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Returning 404 to user: Volume d99f437a-7d93-4677-8dfe-02fce7156d47 could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:51:50.583078 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ee2a013f-6c8b-4199-81db-9e60c4abb2e2 tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/d99f437a-7d93-4677-8dfe-02fce7156d47" status: 404 len: 109 microversion: 2.1 time: 0.248101 Jan 28 00:51:50.584244 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 26/43] 10.222.0.25 () {58 vars in 1247 bytes} [Fri Jan 28 00:51:50 2022] DELETE /compute/v2.1/os-volumes/d99f437a-7d93-4677-8dfe-02fce7156d47 => generated 109 bytes in 250 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:51:50.599022 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-cf528c82-695a-45d0-b550-ce0b3e0f002e tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Calling method '.version_select at 0x7fbbc26e8a60>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:50.751991 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-cf528c82-695a-45d0-b550-ce0b3e0f002e tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] HTTP exception thrown: Volume d99f437a-7d93-4677-8dfe-02fce7156d47 could not be found. Jan 28 00:51:50.753476 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-cf528c82-695a-45d0-b550-ce0b3e0f002e tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] Returning 404 to user: Volume d99f437a-7d93-4677-8dfe-02fce7156d47 could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:51:50.754557 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-cf528c82-695a-45d0-b550-ce0b3e0f002e tempest-VolumesSnapshotsTestJSON-1861889361 tempest-VolumesSnapshotsTestJSON-1861889361-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/d99f437a-7d93-4677-8dfe-02fce7156d47" status: 404 len: 109 microversion: 2.1 time: 0.165437 Jan 28 00:51:50.755690 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 18/44] 10.222.0.25 () {58 vars in 1244 bytes} [Fri Jan 28 00:51:50 2022] GET /compute/v2.1/os-volumes/d99f437a-7d93-4677-8dfe-02fce7156d47 => generated 109 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:51:51.262755 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7f6699ec-a992-4757-9edb-3d420e17d99b tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:51.263431 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7f6699ec-a992-4757-9edb-3d420e17d99b tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:51:51.276421 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7f6699ec-a992-4757-9edb-3d420e17d99b tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:51.280792 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7f6699ec-a992-4757-9edb-3d420e17d99b tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:51.283965 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7f6699ec-a992-4757-9edb-3d420e17d99b tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:51.286000 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7f6699ec-a992-4757-9edb-3d420e17d99b tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:51.619548 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7f6699ec-a992-4757-9edb-3d420e17d99b tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:51:51.645225 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7f6699ec-a992-4757-9edb-3d420e17d99b tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1272 microversion: 2.1 time: 0.387361 Jan 28 00:51:51.647760 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 27/45] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:51:51 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1272 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:51:52.473663 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0744b632-bae5-42f5-aef9-c730623dc705 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-301449229", "imageRef": "7fe09c59-2ff9-4639-b39d-9a474e83ad91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:51:52.669211 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4157ca6d-f3f4-4c18-a61b-6eb3400efc6f tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:52.670114 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4157ca6d-f3f4-4c18-a61b-6eb3400efc6f tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:51:52.701761 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4157ca6d-f3f4-4c18-a61b-6eb3400efc6f tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:52.707786 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4157ca6d-f3f4-4c18-a61b-6eb3400efc6f tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:52.715149 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4157ca6d-f3f4-4c18-a61b-6eb3400efc6f tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:52.719384 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4157ca6d-f3f4-4c18-a61b-6eb3400efc6f tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:52.817873 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.network.neutron [None req-0744b632-bae5-42f5-aef9-c730623dc705 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] validate_networks() for [('4e8d5b9e-49ac-4859-a5cc-c800e2926f38', None, None, None, None, None)] {{(pid=127863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:51:54.950039 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4157ca6d-f3f4-4c18-a61b-6eb3400efc6f tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:51:55.000646 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4157ca6d-f3f4-4c18-a61b-6eb3400efc6f tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1314 microversion: 2.1 time: 2.336187 Jan 28 00:51:55.028981 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 28/46] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:51:52 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1314 bytes in 2367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:51:56.037072 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3b87e234-e2ba-46ef-99eb-fc66ee9e7b17 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:56.040611 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3b87e234-e2ba-46ef-99eb-fc66ee9e7b17 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:51:56.062951 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3b87e234-e2ba-46ef-99eb-fc66ee9e7b17 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:56.065293 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3b87e234-e2ba-46ef-99eb-fc66ee9e7b17 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:56.072074 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3b87e234-e2ba-46ef-99eb-fc66ee9e7b17 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:56.073115 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3b87e234-e2ba-46ef-99eb-fc66ee9e7b17 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:57.918736 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3b87e234-e2ba-46ef-99eb-fc66ee9e7b17 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:51:57.999231 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3b87e234-e2ba-46ef-99eb-fc66ee9e7b17 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1314 microversion: 2.1 time: 1.968216 Jan 28 00:51:58.006760 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 29/47] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:51:56 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1314 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:51:58.115776 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-0744b632-bae5-42f5-aef9-c730623dc705 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Flavor limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:51:58.116660 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-0744b632-bae5-42f5-aef9-c730623dc705 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Image limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:51:58.117917 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-0744b632-bae5-42f5-aef9-c730623dc705 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Flavor pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:51:58.118691 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-0744b632-bae5-42f5-aef9-c730623dc705 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Image pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:51:58.123176 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-0744b632-bae5-42f5-aef9-c730623dc705 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:51:58.158273 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0744b632-bae5-42f5-aef9-c730623dc705 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:58.172002 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0744b632-bae5-42f5-aef9-c730623dc705 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:58.173212 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0744b632-bae5-42f5-aef9-c730623dc705 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:58.173951 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0744b632-bae5-42f5-aef9-c730623dc705 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:58.224679 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-0744b632-bae5-42f5-aef9-c730623dc705 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Getting quotas for project 00e31c63dec9478482118f0b8bd693c8. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:51:58.232672 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-0744b632-bae5-42f5-aef9-c730623dc705 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Getting quotas for user 11f3c09904304ca08793fa87c8f5d61f and project 00e31c63dec9478482118f0b8bd693c8. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:51:58.251542 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0744b632-bae5-42f5-aef9-c730623dc705 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Going to run 1 instances... {{(pid=127863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:51:58.254572 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0744b632-bae5-42f5-aef9-c730623dc705 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fe09c59-2ff9-4639-b39d-9a474e83ad91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:51:58.331217 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0744b632-bae5-42f5-aef9-c730623dc705 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.324190 Jan 28 00:51:58.342323 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-0aaba617-ff85-4539-ae8a-9471a09a5202 req-915df2a2-bb2c-44ef-ba8d-5abfb6d50a7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a61b0a08-48a5-4232-a32d-1722b8c8f471", "tag": "38b56e7d-5a89-4f34-a8b2-6ae9227cbe25"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:51:58.343494 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 19/48] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 00:51:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 6337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 00:51:58.351877 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:51:58.351877 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:51:58.352850 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-afc6a014-8382-4143-8c0f-b02d33005020 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:58.354627 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-afc6a014-8382-4143-8c0f-b02d33005020 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:51:58.411351 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-0aaba617-ff85-4539-ae8a-9471a09a5202 req-915df2a2-bb2c-44ef-ba8d-5abfb6d50a7e service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:58.414925 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-0aaba617-ff85-4539-ae8a-9471a09a5202 req-915df2a2-bb2c-44ef-ba8d-5abfb6d50a7e service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:58.471931 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-0aaba617-ff85-4539-ae8a-9471a09a5202 req-915df2a2-bb2c-44ef-ba8d-5abfb6d50a7e service nova] Creating event network-changed:38b56e7d-5a89-4f34-a8b2-6ae9227cbe25 for instance a61b0a08-48a5-4232-a32d-1722b8c8f471 on hv-cinder-80952 Jan 28 00:51:58.473495 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-0aaba617-ff85-4539-ae8a-9471a09a5202 req-915df2a2-bb2c-44ef-ba8d-5abfb6d50a7e service nova] Acquired lock "compute-rpcapi-router" {{(pid=127862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 28 00:51:58.477438 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f9dfa89d-c124-48a9-9e9d-53742e2a0f63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:58.478538 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f9dfa89d-c124-48a9-9e9d-53742e2a0f63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:58.480660 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f9dfa89d-c124-48a9-9e9d-53742e2a0f63 None None] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:58.481447 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f9dfa89d-c124-48a9-9e9d-53742e2a0f63 None None] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:58.498484 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.compute.rpcapi [None req-f9dfa89d-c124-48a9-9e9d-53742e2a0f63 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 28 00:51:58.500228 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f9dfa89d-c124-48a9-9e9d-53742e2a0f63 None None] Releasing lock "compute-rpcapi-router" {{(pid=127862) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 28 00:51:58.608708 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f9dfa89d-c124-48a9-9e9d-53742e2a0f63 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.599805 Jan 28 00:51:58.609346 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 30/49] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:51:58.702417 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-afc6a014-8382-4143-8c0f-b02d33005020 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:51:58.750731 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-afc6a014-8382-4143-8c0f-b02d33005020 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1221 microversion: 2.1 time: 0.405077 Jan 28 00:51:58.751779 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 20/50] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:51:58 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1221 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:51:59.038741 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-c03bb9bb-4030-4829-882b-90ca84070b18 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:51:59.040048 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-c03bb9bb-4030-4829-882b-90ca84070b18 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:51:59.073172 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c03bb9bb-4030-4829-882b-90ca84070b18 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:59.073641 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c03bb9bb-4030-4829-882b-90ca84070b18 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:59.079466 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c03bb9bb-4030-4829-882b-90ca84070b18 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:51:59.080027 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c03bb9bb-4030-4829-882b-90ca84070b18 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:51:59.095736 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-57fedc8a-2978-4515-8585-6c845f6abcc2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-480052268", "imageRef": "7fe09c59-2ff9-4639-b39d-9a474e83ad91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:51:59.400045 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.network.neutron [None req-57fedc8a-2978-4515-8585-6c845f6abcc2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] validate_networks() for [('4e8d5b9e-49ac-4859-a5cc-c800e2926f38', None, None, None, None, None)] {{(pid=127863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:51:59.989446 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c03bb9bb-4030-4829-882b-90ca84070b18 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:51:59.998456 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-c03bb9bb-4030-4829-882b-90ca84070b18 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1314 microversion: 2.1 time: 0.967818 Jan 28 00:52:00.006396 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 31/51] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:51:59 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1314 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:00.013428 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4af886fd-eb2c-42d5-a927-e1a375c833fe tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1595970120", "imageRef": "7fe09c59-2ff9-4639-b39d-9a474e83ad91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60bc67ad-875c-4481-b3b6-be4a8a149f54"}], "security_groups": [{"name": "tempest-securitygroup--739297403"}], "key_name": "tempest-keypair-1847242233", "user_data": "}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:00.676335 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.network.neutron [None req-4af886fd-eb2c-42d5-a927-e1a375c833fe tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] validate_networks() for [('60bc67ad-875c-4481-b3b6-be4a8a149f54', None, None, None, None, None)] {{(pid=127862) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:52:01.613813 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-57fedc8a-2978-4515-8585-6c845f6abcc2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Flavor limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:52:01.615634 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-57fedc8a-2978-4515-8585-6c845f6abcc2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Image limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:52:01.618223 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-57fedc8a-2978-4515-8585-6c845f6abcc2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Flavor pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:52:01.619313 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-57fedc8a-2978-4515-8585-6c845f6abcc2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Image pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:52:01.620267 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-57fedc8a-2978-4515-8585-6c845f6abcc2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:52:01.633589 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-57fedc8a-2978-4515-8585-6c845f6abcc2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:01.635637 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-57fedc8a-2978-4515-8585-6c845f6abcc2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:01.637069 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-57fedc8a-2978-4515-8585-6c845f6abcc2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:01.638206 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-57fedc8a-2978-4515-8585-6c845f6abcc2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:01.676753 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-57fedc8a-2978-4515-8585-6c845f6abcc2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Getting quotas for project 00e31c63dec9478482118f0b8bd693c8. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:52:01.694757 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-57fedc8a-2978-4515-8585-6c845f6abcc2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Getting quotas for user 11f3c09904304ca08793fa87c8f5d61f and project 00e31c63dec9478482118f0b8bd693c8. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:52:01.717357 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-57fedc8a-2978-4515-8585-6c845f6abcc2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Going to run 1 instances... {{(pid=127863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:52:01.722102 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-57fedc8a-2978-4515-8585-6c845f6abcc2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fe09c59-2ff9-4639-b39d-9a474e83ad91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:52:01.827597 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-57fedc8a-2978-4515-8585-6c845f6abcc2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.736410 Jan 28 00:52:01.833288 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 21/52] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 00:51:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 00:52:01.843000 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-093cbe94-b354-46d8-8324-5763a3c6aec7 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:01.843893 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-093cbe94-b354-46d8-8324-5763a3c6aec7 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:01.861901 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-093cbe94-b354-46d8-8324-5763a3c6aec7 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:01.875802 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-093cbe94-b354-46d8-8324-5763a3c6aec7 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:01.884460 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-093cbe94-b354-46d8-8324-5763a3c6aec7 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:01.885187 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-093cbe94-b354-46d8-8324-5763a3c6aec7 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:02.369843 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-093cbe94-b354-46d8-8324-5763a3c6aec7 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:02.406150 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-093cbe94-b354-46d8-8324-5763a3c6aec7 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1314 microversion: 2.1 time: 0.574299 Jan 28 00:52:02.416657 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 22/53] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:01 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:02.419485 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c71b81bd-89f3-41fb-b189-f132c44e2f51 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:02.420352 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c71b81bd-89f3-41fb-b189-f132c44e2f51 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:02.607886 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-c71b81bd-89f3-41fb-b189-f132c44e2f51 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:02.626170 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c71b81bd-89f3-41fb-b189-f132c44e2f51 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1221 microversion: 2.1 time: 0.218031 Jan 28 00:52:02.627224 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 23/54] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:02 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1221 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:02.832862 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-4af886fd-eb2c-42d5-a927-e1a375c833fe tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Flavor limits 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:52:02.835196 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-4af886fd-eb2c-42d5-a927-e1a375c833fe tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Image limits 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:52:02.838422 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-4af886fd-eb2c-42d5-a927-e1a375c833fe tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Flavor pref 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:52:02.839524 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-4af886fd-eb2c-42d5-a927-e1a375c833fe tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Image pref 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:52:02.840579 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-4af886fd-eb2c-42d5-a927-e1a375c833fe tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:52:02.873528 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4af886fd-eb2c-42d5-a927-e1a375c833fe tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:02.874960 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4af886fd-eb2c-42d5-a927-e1a375c833fe tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:02.877277 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4af886fd-eb2c-42d5-a927-e1a375c833fe tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:02.878346 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4af886fd-eb2c-42d5-a927-e1a375c833fe tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:02.948958 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-4af886fd-eb2c-42d5-a927-e1a375c833fe tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Getting quotas for project 6db84ca9b72548269154e343a33767b4. Resources: {'instances', 'cores', 'ram'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:52:02.964075 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-4af886fd-eb2c-42d5-a927-e1a375c833fe tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Getting quotas for user ec5dffa23e574a9e97867c93c033fcdc and project 6db84ca9b72548269154e343a33767b4. Resources: {'instances', 'cores', 'ram'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:52:02.988212 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4af886fd-eb2c-42d5-a927-e1a375c833fe tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Going to run 1 instances... {{(pid=127862) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:52:02.997938 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4af886fd-eb2c-42d5-a927-e1a375c833fe tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fe09c59-2ff9-4639-b39d-9a474e83ad91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:52:03.089395 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4af886fd-eb2c-42d5-a927-e1a375c833fe tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.081295 Jan 28 00:52:03.096176 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 32/55] 10.222.0.25 () {62 vars in 1187 bytes} [Fri Jan 28 00:52:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 3089 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 28 00:52:03.113303 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-628f66b1-e3b3-4d6f-817f-4498a8cb0585 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:03.114700 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-628f66b1-e3b3-4d6f-817f-4498a8cb0585 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:03.331544 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-628f66b1-e3b3-4d6f-817f-4498a8cb0585 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:03.346837 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-628f66b1-e3b3-4d6f-817f-4498a8cb0585 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:03.350122 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-628f66b1-e3b3-4d6f-817f-4498a8cb0585 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:03.361581 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-628f66b1-e3b3-4d6f-817f-4498a8cb0585 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1282 microversion: 2.20 time: 0.254528 Jan 28 00:52:03.365641 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 24/56] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:03 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1282 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:03.433726 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-2333473a-016a-4055-a637-c2998232b174 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:03.434842 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-2333473a-016a-4055-a637-c2998232b174 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:03.451147 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2333473a-016a-4055-a637-c2998232b174 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:03.452206 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2333473a-016a-4055-a637-c2998232b174 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:03.453823 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2333473a-016a-4055-a637-c2998232b174 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:03.454917 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2333473a-016a-4055-a637-c2998232b174 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:03.658374 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e1729188-450e-4b62-beec-96148fe7efc5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:03.661403 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e1729188-450e-4b62-beec-96148fe7efc5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:03.689306 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e1729188-450e-4b62-beec-96148fe7efc5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:03.690393 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e1729188-450e-4b62-beec-96148fe7efc5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:03.691988 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e1729188-450e-4b62-beec-96148fe7efc5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:03.693260 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e1729188-450e-4b62-beec-96148fe7efc5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:03.943946 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e1729188-450e-4b62-beec-96148fe7efc5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:03.981773 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-2333473a-016a-4055-a637-c2998232b174 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:03.988909 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e1729188-450e-4b62-beec-96148fe7efc5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1225 microversion: 2.1 time: 0.329711 Jan 28 00:52:03.990430 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 25/57] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:03 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1225 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:04.044870 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-2333473a-016a-4055-a637-c2998232b174 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1314 microversion: 2.1 time: 0.608262 Jan 28 00:52:04.049766 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 33/58] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:03 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:04.399784 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-95628598-6155-45f9-9e25-4ac4009cee5a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:04.402440 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-95628598-6155-45f9-9e25-4ac4009cee5a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:04.416584 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-95628598-6155-45f9-9e25-4ac4009cee5a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:04.417361 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-95628598-6155-45f9-9e25-4ac4009cee5a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:04.418901 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-95628598-6155-45f9-9e25-4ac4009cee5a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:04.419717 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-95628598-6155-45f9-9e25-4ac4009cee5a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:04.590596 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-95628598-6155-45f9-9e25-4ac4009cee5a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:04.606495 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-95628598-6155-45f9-9e25-4ac4009cee5a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:04.608090 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-95628598-6155-45f9-9e25-4ac4009cee5a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:04.609241 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-95628598-6155-45f9-9e25-4ac4009cee5a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1286 microversion: 2.20 time: 0.231631 Jan 28 00:52:04.619833 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 26/59] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:04 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1286 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:05.018964 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-45166585-f787-44bb-b2f0-06ba03881b82 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:05.019930 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-45166585-f787-44bb-b2f0-06ba03881b82 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:05.038654 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-45166585-f787-44bb-b2f0-06ba03881b82 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:05.040008 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-45166585-f787-44bb-b2f0-06ba03881b82 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:05.043166 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-45166585-f787-44bb-b2f0-06ba03881b82 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:05.050302 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-45166585-f787-44bb-b2f0-06ba03881b82 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:05.079045 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5b3935b5-7492-4b43-8530-72b5814e1be3 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:05.086250 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5b3935b5-7492-4b43-8530-72b5814e1be3 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:05.114087 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5b3935b5-7492-4b43-8530-72b5814e1be3 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:05.116960 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5b3935b5-7492-4b43-8530-72b5814e1be3 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:05.121901 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5b3935b5-7492-4b43-8530-72b5814e1be3 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:05.124457 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5b3935b5-7492-4b43-8530-72b5814e1be3 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:05.358951 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-45166585-f787-44bb-b2f0-06ba03881b82 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:05.386164 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-45166585-f787-44bb-b2f0-06ba03881b82 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1225 microversion: 2.1 time: 0.370899 Jan 28 00:52:05.392717 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 34/60] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:05 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1225 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:05.639234 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-21f5ea55-d7a0-4c52-8b0e-39d500caee31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:05.640394 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-21f5ea55-d7a0-4c52-8b0e-39d500caee31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:05.667065 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-21f5ea55-d7a0-4c52-8b0e-39d500caee31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:05.671514 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-21f5ea55-d7a0-4c52-8b0e-39d500caee31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:05.675970 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-21f5ea55-d7a0-4c52-8b0e-39d500caee31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:05.699914 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-21f5ea55-d7a0-4c52-8b0e-39d500caee31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:06.323652 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-5b3935b5-7492-4b43-8530-72b5814e1be3 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:06.333265 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5b3935b5-7492-4b43-8530-72b5814e1be3 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1314 microversion: 2.1 time: 1.270120 Jan 28 00:52:06.337784 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 27/61] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:05 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1314 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:06.345461 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-21f5ea55-d7a0-4c52-8b0e-39d500caee31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:06.372944 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-21f5ea55-d7a0-4c52-8b0e-39d500caee31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:06.376317 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-21f5ea55-d7a0-4c52-8b0e-39d500caee31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:06.377818 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-21f5ea55-d7a0-4c52-8b0e-39d500caee31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1286 microversion: 2.20 time: 0.747108 Jan 28 00:52:06.399724 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 35/62] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:05 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1286 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:52:06.419511 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-518745ef-d492-473c-9cb1-0792e0e156d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:06.420299 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-518745ef-d492-473c-9cb1-0792e0e156d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:06.432017 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-518745ef-d492-473c-9cb1-0792e0e156d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:06.437025 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-518745ef-d492-473c-9cb1-0792e0e156d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:06.438729 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-518745ef-d492-473c-9cb1-0792e0e156d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:06.441115 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-518745ef-d492-473c-9cb1-0792e0e156d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:06.804253 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-518745ef-d492-473c-9cb1-0792e0e156d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:06.812819 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-518745ef-d492-473c-9cb1-0792e0e156d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1273 microversion: 2.1 time: 0.397458 Jan 28 00:52:06.816985 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 28/63] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:06 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1273 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:07.367705 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1afcb0d2-94f4-4a96-a5f1-1e08871273b5 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:07.379973 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1afcb0d2-94f4-4a96-a5f1-1e08871273b5 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:07.409858 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1afcb0d2-94f4-4a96-a5f1-1e08871273b5 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:07.417860 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1afcb0d2-94f4-4a96-a5f1-1e08871273b5 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:07.418792 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1afcb0d2-94f4-4a96-a5f1-1e08871273b5 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:07.430668 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1afcb0d2-94f4-4a96-a5f1-1e08871273b5 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:07.446396 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-8caf64de-88df-4231-a1d2-5760c0f1bc28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:07.447957 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-8caf64de-88df-4231-a1d2-5760c0f1bc28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:07.485592 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8caf64de-88df-4231-a1d2-5760c0f1bc28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:07.488106 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8caf64de-88df-4231-a1d2-5760c0f1bc28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:07.490307 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8caf64de-88df-4231-a1d2-5760c0f1bc28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:07.496377 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8caf64de-88df-4231-a1d2-5760c0f1bc28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:07.979618 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-8caf64de-88df-4231-a1d2-5760c0f1bc28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:08.004765 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-8caf64de-88df-4231-a1d2-5760c0f1bc28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:08.012164 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-8caf64de-88df-4231-a1d2-5760c0f1bc28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:08.016869 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-8caf64de-88df-4231-a1d2-5760c0f1bc28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1352 microversion: 2.20 time: 0.619452 Jan 28 00:52:08.025063 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 29/64] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:07 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1352 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:52:08.042744 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-16c16eab-78f9-41ff-bdfe-360bb853782b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:08.043927 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-16c16eab-78f9-41ff-bdfe-360bb853782b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:08.067323 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-16c16eab-78f9-41ff-bdfe-360bb853782b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:08.068092 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-16c16eab-78f9-41ff-bdfe-360bb853782b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:08.069565 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-16c16eab-78f9-41ff-bdfe-360bb853782b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:08.070326 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-16c16eab-78f9-41ff-bdfe-360bb853782b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:08.285456 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-16c16eab-78f9-41ff-bdfe-360bb853782b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:08.292246 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-1afcb0d2-94f4-4a96-a5f1-1e08871273b5 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:08.295844 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-16c16eab-78f9-41ff-bdfe-360bb853782b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1279 microversion: 2.1 time: 0.268897 Jan 28 00:52:08.301113 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1afcb0d2-94f4-4a96-a5f1-1e08871273b5 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1314 microversion: 2.1 time: 0.947399 Jan 28 00:52:08.310861 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 30/65] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:08 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1279 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:08.312094 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 36/66] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:07 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1314 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:09.057817 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-54d543e1-fa0c-4e9f-98ac-c371cf72be2e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:09.061522 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-54d543e1-fa0c-4e9f-98ac-c371cf72be2e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:09.078699 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-54d543e1-fa0c-4e9f-98ac-c371cf72be2e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:09.080333 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-54d543e1-fa0c-4e9f-98ac-c371cf72be2e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:09.083325 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-54d543e1-fa0c-4e9f-98ac-c371cf72be2e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:09.084028 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-54d543e1-fa0c-4e9f-98ac-c371cf72be2e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:09.238762 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-54d543e1-fa0c-4e9f-98ac-c371cf72be2e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:09.262008 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-54d543e1-fa0c-4e9f-98ac-c371cf72be2e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:09.263612 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-54d543e1-fa0c-4e9f-98ac-c371cf72be2e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:09.275025 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-54d543e1-fa0c-4e9f-98ac-c371cf72be2e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1340 microversion: 2.20 time: 0.223597 Jan 28 00:52:09.277967 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 31/67] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:09 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1340 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:09.315462 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-63150d35-a666-42c8-9b5c-9f69922cd5d0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:09.317005 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-63150d35-a666-42c8-9b5c-9f69922cd5d0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:09.326441 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-678f630a-fac2-445f-9a07-f9c43a73faf7 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:09.327062 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-63150d35-a666-42c8-9b5c-9f69922cd5d0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:09.327191 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-678f630a-fac2-445f-9a07-f9c43a73faf7 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:09.328002 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-63150d35-a666-42c8-9b5c-9f69922cd5d0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:09.329043 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-63150d35-a666-42c8-9b5c-9f69922cd5d0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:09.329731 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-63150d35-a666-42c8-9b5c-9f69922cd5d0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:09.344715 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-678f630a-fac2-445f-9a07-f9c43a73faf7 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:09.346665 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-678f630a-fac2-445f-9a07-f9c43a73faf7 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:09.348211 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-678f630a-fac2-445f-9a07-f9c43a73faf7 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:09.357898 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-678f630a-fac2-445f-9a07-f9c43a73faf7 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:09.843125 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-678f630a-fac2-445f-9a07-f9c43a73faf7 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:09.856446 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-678f630a-fac2-445f-9a07-f9c43a73faf7 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1314 microversion: 2.1 time: 0.540888 Jan 28 00:52:09.864532 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 32/68] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:09 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:09.900910 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-63150d35-a666-42c8-9b5c-9f69922cd5d0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:09.922346 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-63150d35-a666-42c8-9b5c-9f69922cd5d0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.611552 Jan 28 00:52:09.923492 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 37/69] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:09 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:10.303369 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-925f12da-bbb1-413e-8399-abd5a28810ce tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:10.304521 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-925f12da-bbb1-413e-8399-abd5a28810ce tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:10.314424 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-925f12da-bbb1-413e-8399-abd5a28810ce tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:10.315203 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-925f12da-bbb1-413e-8399-abd5a28810ce tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:10.316503 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-925f12da-bbb1-413e-8399-abd5a28810ce tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:10.317282 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-925f12da-bbb1-413e-8399-abd5a28810ce tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:10.467508 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-925f12da-bbb1-413e-8399-abd5a28810ce tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:10.484234 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-925f12da-bbb1-413e-8399-abd5a28810ce tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:10.487863 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-925f12da-bbb1-413e-8399-abd5a28810ce tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:10.490614 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-925f12da-bbb1-413e-8399-abd5a28810ce tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1340 microversion: 2.20 time: 0.195308 Jan 28 00:52:10.491890 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 33/70] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:10 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1340 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:10.874871 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-92848af2-b93c-4aa3-bbe7-8bfb80b25d49 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:10.875923 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-92848af2-b93c-4aa3-bbe7-8bfb80b25d49 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:10.889333 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-92848af2-b93c-4aa3-bbe7-8bfb80b25d49 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:10.890378 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-92848af2-b93c-4aa3-bbe7-8bfb80b25d49 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:10.892017 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-92848af2-b93c-4aa3-bbe7-8bfb80b25d49 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:10.892977 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-92848af2-b93c-4aa3-bbe7-8bfb80b25d49 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:10.950800 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-36a55b5a-102e-4126-bea0-54670b122cbd tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:10.952581 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-36a55b5a-102e-4126-bea0-54670b122cbd tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:10.962342 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-36a55b5a-102e-4126-bea0-54670b122cbd tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:10.964640 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-36a55b5a-102e-4126-bea0-54670b122cbd tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:10.965692 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-36a55b5a-102e-4126-bea0-54670b122cbd tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:10.966726 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-36a55b5a-102e-4126-bea0-54670b122cbd tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:11.863643 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-92848af2-b93c-4aa3-bbe7-8bfb80b25d49 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:11.875125 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-92848af2-b93c-4aa3-bbe7-8bfb80b25d49 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1314 microversion: 2.1 time: 1.005064 Jan 28 00:52:11.881106 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 38/71] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:10 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1314 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:11.892386 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-36a55b5a-102e-4126-bea0-54670b122cbd tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:11.902794 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-80bf4df6-a6c6-4c9a-84a2-96392f7e137b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:11.909894 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-36a55b5a-102e-4126-bea0-54670b122cbd tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.967499 Jan 28 00:52:11.912162 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 34/72] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:10 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:11.912992 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-80bf4df6-a6c6-4c9a-84a2-96392f7e137b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:11.925074 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-80bf4df6-a6c6-4c9a-84a2-96392f7e137b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:11.925538 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-80bf4df6-a6c6-4c9a-84a2-96392f7e137b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:11.932088 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-80bf4df6-a6c6-4c9a-84a2-96392f7e137b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:11.934592 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-80bf4df6-a6c6-4c9a-84a2-96392f7e137b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:12.121090 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-80bf4df6-a6c6-4c9a-84a2-96392f7e137b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:12.160667 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-80bf4df6-a6c6-4c9a-84a2-96392f7e137b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:12.166682 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-80bf4df6-a6c6-4c9a-84a2-96392f7e137b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:12.167088 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-80bf4df6-a6c6-4c9a-84a2-96392f7e137b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1340 microversion: 2.20 time: 0.281928 Jan 28 00:52:12.168016 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 39/73] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:11 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1340 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:12.906783 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2bfcaab7-7458-4bf4-8395-5b9de666c533 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:12.907931 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2bfcaab7-7458-4bf4-8395-5b9de666c533 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:12.928043 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-c938cb18-2b28-46f5-83fe-79f0ac3636bb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:12.929497 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-c938cb18-2b28-46f5-83fe-79f0ac3636bb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:12.931850 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2bfcaab7-7458-4bf4-8395-5b9de666c533 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:12.932333 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2bfcaab7-7458-4bf4-8395-5b9de666c533 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:12.933165 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2bfcaab7-7458-4bf4-8395-5b9de666c533 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:12.933766 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2bfcaab7-7458-4bf4-8395-5b9de666c533 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:12.958154 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c938cb18-2b28-46f5-83fe-79f0ac3636bb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:12.961760 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c938cb18-2b28-46f5-83fe-79f0ac3636bb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:12.962840 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c938cb18-2b28-46f5-83fe-79f0ac3636bb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:12.963481 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c938cb18-2b28-46f5-83fe-79f0ac3636bb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:13.887198 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-2bfcaab7-7458-4bf4-8395-5b9de666c533 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:13.901611 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2bfcaab7-7458-4bf4-8395-5b9de666c533 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1314 microversion: 2.1 time: 1.002372 Jan 28 00:52:13.902713 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 35/74] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:12 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1314 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:13.911416 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-76f7e0c5-37ee-4e37-a3c8-a1afe49b6494 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:13.916843 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-76f7e0c5-37ee-4e37-a3c8-a1afe49b6494 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:13.930235 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-76f7e0c5-37ee-4e37-a3c8-a1afe49b6494 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:13.931963 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-76f7e0c5-37ee-4e37-a3c8-a1afe49b6494 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:13.934494 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-76f7e0c5-37ee-4e37-a3c8-a1afe49b6494 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:13.935090 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-76f7e0c5-37ee-4e37-a3c8-a1afe49b6494 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:13.961379 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c938cb18-2b28-46f5-83fe-79f0ac3636bb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:13.969075 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-c938cb18-2b28-46f5-83fe-79f0ac3636bb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 1.046695 Jan 28 00:52:13.969677 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 40/75] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:12 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:14.251728 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-76f7e0c5-37ee-4e37-a3c8-a1afe49b6494 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:14.266319 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-76f7e0c5-37ee-4e37-a3c8-a1afe49b6494 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:14.270047 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-76f7e0c5-37ee-4e37-a3c8-a1afe49b6494 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:14.272803 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-76f7e0c5-37ee-4e37-a3c8-a1afe49b6494 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1407 microversion: 2.20 time: 0.365679 Jan 28 00:52:14.274475 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 36/76] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:13 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1407 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:14.425695 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-78759e08-7f10-4020-be37-cf55107b6f9d req-1eaa8014-6543-4b12-a5fc-23f425109354 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e", "tag": "e865b513-e08e-40ae-b53a-9cc6744e4709"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:14.427830 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:52:14.427830 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:52:14.440857 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-78759e08-7f10-4020-be37-cf55107b6f9d req-1eaa8014-6543-4b12-a5fc-23f425109354 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:14.442700 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-78759e08-7f10-4020-be37-cf55107b6f9d req-1eaa8014-6543-4b12-a5fc-23f425109354 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:14.460207 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-78759e08-7f10-4020-be37-cf55107b6f9d req-1eaa8014-6543-4b12-a5fc-23f425109354 service nova] Creating event network-changed:e865b513-e08e-40ae-b53a-9cc6744e4709 for instance 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e on hv-cinder-80952 Jan 28 00:52:14.467472 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-78759e08-7f10-4020-be37-cf55107b6f9d req-1eaa8014-6543-4b12-a5fc-23f425109354 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123715 Jan 28 00:52:14.468292 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 41/77] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:52:14.933436 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-eda6ba59-bdfe-48dc-9fb0-9385f788d700 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:14.935318 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-eda6ba59-bdfe-48dc-9fb0-9385f788d700 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:14.944651 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-eda6ba59-bdfe-48dc-9fb0-9385f788d700 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:14.945989 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-eda6ba59-bdfe-48dc-9fb0-9385f788d700 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:14.947338 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-eda6ba59-bdfe-48dc-9fb0-9385f788d700 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:14.948348 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-eda6ba59-bdfe-48dc-9fb0-9385f788d700 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:15.011191 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-bea5226a-9e12-4db3-938f-08680011d5f1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:15.017466 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-bea5226a-9e12-4db3-938f-08680011d5f1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:15.029081 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bea5226a-9e12-4db3-938f-08680011d5f1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:15.033733 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bea5226a-9e12-4db3-938f-08680011d5f1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:15.036221 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bea5226a-9e12-4db3-938f-08680011d5f1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:15.041280 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bea5226a-9e12-4db3-938f-08680011d5f1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:15.431542 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-eda6ba59-bdfe-48dc-9fb0-9385f788d700 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:15.469663 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-eda6ba59-bdfe-48dc-9fb0-9385f788d700 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1314 microversion: 2.1 time: 0.537803 Jan 28 00:52:15.471833 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 37/78] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:14 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:15.502397 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-31200bda-ee3f-4c5f-b4b7-1442d58b3015 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:15.504585 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-31200bda-ee3f-4c5f-b4b7-1442d58b3015 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:15.514359 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-bea5226a-9e12-4db3-938f-08680011d5f1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:15.519923 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-31200bda-ee3f-4c5f-b4b7-1442d58b3015 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:15.520597 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-31200bda-ee3f-4c5f-b4b7-1442d58b3015 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:15.522928 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-31200bda-ee3f-4c5f-b4b7-1442d58b3015 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:15.523768 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-31200bda-ee3f-4c5f-b4b7-1442d58b3015 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:15.540948 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-bea5226a-9e12-4db3-938f-08680011d5f1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.544122 Jan 28 00:52:15.551222 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 42/79] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:14 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:15.707044 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-0730af4f-1b1c-4389-bbfe-de5efd454eab req-4f5bc8e2-6f7b-4923-8b26-fe9c86567ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4", "tag": "83fc2ec7-8030-466d-ac4d-dc369ac1f250"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:15.711796 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:52:15.711796 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:52:15.750715 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-0730af4f-1b1c-4389-bbfe-de5efd454eab req-4f5bc8e2-6f7b-4923-8b26-fe9c86567ce0 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:15.751322 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-0730af4f-1b1c-4389-bbfe-de5efd454eab req-4f5bc8e2-6f7b-4923-8b26-fe9c86567ce0 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:15.809510 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-0730af4f-1b1c-4389-bbfe-de5efd454eab req-4f5bc8e2-6f7b-4923-8b26-fe9c86567ce0 service nova] Creating event network-changed:83fc2ec7-8030-466d-ac4d-dc369ac1f250 for instance 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 on hv-cinder-80952 Jan 28 00:52:15.822098 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-0730af4f-1b1c-4389-bbfe-de5efd454eab req-4f5bc8e2-6f7b-4923-8b26-fe9c86567ce0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132167 Jan 28 00:52:15.823969 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 43/80] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:52:15.880366 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-31200bda-ee3f-4c5f-b4b7-1442d58b3015 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:15.897816 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-31200bda-ee3f-4c5f-b4b7-1442d58b3015 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:15.900437 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-31200bda-ee3f-4c5f-b4b7-1442d58b3015 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:15.902279 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-31200bda-ee3f-4c5f-b4b7-1442d58b3015 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1407 microversion: 2.20 time: 0.408709 Jan 28 00:52:15.914676 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 38/81] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:15 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:16.502853 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-010f25e2-15c1-4364-a724-26f5ffc82852 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:16.505847 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-010f25e2-15c1-4364-a724-26f5ffc82852 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:16.518767 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-010f25e2-15c1-4364-a724-26f5ffc82852 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:16.520239 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-010f25e2-15c1-4364-a724-26f5ffc82852 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:16.522828 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-010f25e2-15c1-4364-a724-26f5ffc82852 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:16.524317 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-010f25e2-15c1-4364-a724-26f5ffc82852 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:16.580209 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-bf352bb6-2f30-47af-9a81-9c35746dc218 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:16.582456 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-bf352bb6-2f30-47af-9a81-9c35746dc218 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:16.598589 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bf352bb6-2f30-47af-9a81-9c35746dc218 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:16.600829 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bf352bb6-2f30-47af-9a81-9c35746dc218 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:16.602715 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bf352bb6-2f30-47af-9a81-9c35746dc218 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:16.604148 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bf352bb6-2f30-47af-9a81-9c35746dc218 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:17.030348 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-010f25e2-15c1-4364-a724-26f5ffc82852 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:17.031856 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-bf352bb6-2f30-47af-9a81-9c35746dc218 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:17.054449 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-010f25e2-15c1-4364-a724-26f5ffc82852 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1314 microversion: 2.1 time: 0.558407 Jan 28 00:52:17.070493 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-bf352bb6-2f30-47af-9a81-9c35746dc218 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.496679 Jan 28 00:52:17.077242 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 44/82] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:16 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:17.082733 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 39/83] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:16 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:17.105166 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-464f1e06-3a1c-47b6-a368-a75ff1686b73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:17.107311 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-464f1e06-3a1c-47b6-a368-a75ff1686b73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:17.133893 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-464f1e06-3a1c-47b6-a368-a75ff1686b73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:17.135723 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-464f1e06-3a1c-47b6-a368-a75ff1686b73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:17.140329 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-464f1e06-3a1c-47b6-a368-a75ff1686b73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:17.142774 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-464f1e06-3a1c-47b6-a368-a75ff1686b73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:17.655029 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-464f1e06-3a1c-47b6-a368-a75ff1686b73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:17.681106 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-464f1e06-3a1c-47b6-a368-a75ff1686b73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:17.689893 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-464f1e06-3a1c-47b6-a368-a75ff1686b73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:17.692077 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-464f1e06-3a1c-47b6-a368-a75ff1686b73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1407 microversion: 2.20 time: 0.612528 Jan 28 00:52:17.692947 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 45/84] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:17 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1407 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:17.942578 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-41408a64-e8a5-4f6c-a200-133b362d4f36 req-9f4443a9-8165-4697-b7e3-3410d2216402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35f84832-ed83-48ac-a8cb-f3a87abd47bd", "tag": "8dcfa13b-a8cd-4dce-8441-ad8f8ab5dda8"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:17.947410 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:52:17.947410 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:52:17.992805 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-41408a64-e8a5-4f6c-a200-133b362d4f36 req-9f4443a9-8165-4697-b7e3-3410d2216402 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:18.006056 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-41408a64-e8a5-4f6c-a200-133b362d4f36 req-9f4443a9-8165-4697-b7e3-3410d2216402 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:18.063029 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-41408a64-e8a5-4f6c-a200-133b362d4f36 req-9f4443a9-8165-4697-b7e3-3410d2216402 service nova] Creating event network-changed:8dcfa13b-a8cd-4dce-8441-ad8f8ab5dda8 for instance 35f84832-ed83-48ac-a8cb-f3a87abd47bd on hv-cinder-80952 Jan 28 00:52:18.063622 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-41408a64-e8a5-4f6c-a200-133b362d4f36 req-9f4443a9-8165-4697-b7e3-3410d2216402 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 28 00:52:18.064983 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6135d9c6-a018-4bc9-8e58-9e4be197efcf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:18.065692 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6135d9c6-a018-4bc9-8e58-9e4be197efcf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:18.066746 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6135d9c6-a018-4bc9-8e58-9e4be197efcf None None] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:18.067411 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6135d9c6-a018-4bc9-8e58-9e4be197efcf None None] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:18.098534 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1bce78f1-b59f-4ffa-87db-ec4b5cd32622 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:18.101461 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1bce78f1-b59f-4ffa-87db-ec4b5cd32622 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:18.112506 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.compute.rpcapi [None req-6135d9c6-a018-4bc9-8e58-9e4be197efcf None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 28 00:52:18.113849 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6135d9c6-a018-4bc9-8e58-9e4be197efcf None None] Releasing lock "compute-rpcapi-router" {{(pid=127863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 28 00:52:18.116136 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1bce78f1-b59f-4ffa-87db-ec4b5cd32622 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:18.126886 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1bce78f1-b59f-4ffa-87db-ec4b5cd32622 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:18.132374 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1bce78f1-b59f-4ffa-87db-ec4b5cd32622 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:18.137193 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1bce78f1-b59f-4ffa-87db-ec4b5cd32622 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:18.157276 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-6135d9c6-a018-4bc9-8e58-9e4be197efcf None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221004 Jan 28 00:52:18.158606 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 40/85] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:52:18.196569 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c859aa70-9ebc-45fe-a600-c2f5911de5ba tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:18.199636 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c859aa70-9ebc-45fe-a600-c2f5911de5ba tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:18.225573 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c859aa70-9ebc-45fe-a600-c2f5911de5ba tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:18.231211 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c859aa70-9ebc-45fe-a600-c2f5911de5ba tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:18.234706 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c859aa70-9ebc-45fe-a600-c2f5911de5ba tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:18.235418 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c859aa70-9ebc-45fe-a600-c2f5911de5ba tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:19.072141 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-1bce78f1-b59f-4ffa-87db-ec4b5cd32622 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:19.086875 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1bce78f1-b59f-4ffa-87db-ec4b5cd32622 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.991937 Jan 28 00:52:19.087527 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 46/86] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:18 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:19.102210 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-99f83dc2-f51b-4ebb-b14a-0c3c633c0c16 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:19.102841 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-99f83dc2-f51b-4ebb-b14a-0c3c633c0c16 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:19.108431 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-c859aa70-9ebc-45fe-a600-c2f5911de5ba tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:19.121823 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c859aa70-9ebc-45fe-a600-c2f5911de5ba tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1314 microversion: 2.1 time: 0.952021 Jan 28 00:52:19.122543 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 41/87] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:18 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1314 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:19.142749 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-99f83dc2-f51b-4ebb-b14a-0c3c633c0c16 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:19.151921 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-99f83dc2-f51b-4ebb-b14a-0c3c633c0c16 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:19.153094 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-99f83dc2-f51b-4ebb-b14a-0c3c633c0c16 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:19.153659 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-99f83dc2-f51b-4ebb-b14a-0c3c633c0c16 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:19.622912 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-99f83dc2-f51b-4ebb-b14a-0c3c633c0c16 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:19.648687 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-99f83dc2-f51b-4ebb-b14a-0c3c633c0c16 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:19.653991 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-99f83dc2-f51b-4ebb-b14a-0c3c633c0c16 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:19.658278 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-99f83dc2-f51b-4ebb-b14a-0c3c633c0c16 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1407 microversion: 2.20 time: 0.560383 Jan 28 00:52:19.661640 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 47/88] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:19 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1407 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:20.108345 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5b639b82-febe-415c-97c7-94292ae2a06f tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:20.109348 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5b639b82-febe-415c-97c7-94292ae2a06f tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:20.127766 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5b639b82-febe-415c-97c7-94292ae2a06f tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:20.128960 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5b639b82-febe-415c-97c7-94292ae2a06f tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:20.137826 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5b639b82-febe-415c-97c7-94292ae2a06f tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:20.138930 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5b639b82-febe-415c-97c7-94292ae2a06f tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:20.142320 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9e4f1602-4c52-42b5-a391-fa7e638cb0ed tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:20.143056 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9e4f1602-4c52-42b5-a391-fa7e638cb0ed tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:20.151218 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9e4f1602-4c52-42b5-a391-fa7e638cb0ed tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:20.155428 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9e4f1602-4c52-42b5-a391-fa7e638cb0ed tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:20.156412 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9e4f1602-4c52-42b5-a391-fa7e638cb0ed tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:20.157077 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9e4f1602-4c52-42b5-a391-fa7e638cb0ed tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:20.688278 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9e4f1602-4c52-42b5-a391-fa7e638cb0ed tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:20.731899 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9e4f1602-4c52-42b5-a391-fa7e638cb0ed tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1314 microversion: 2.1 time: 0.593933 Jan 28 00:52:20.753070 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 48/89] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:20 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:20.803596 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9d0b4fbd-7a86-45f2-aa70-51932ea2b6ae tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:20.808333 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9d0b4fbd-7a86-45f2-aa70-51932ea2b6ae tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:20.843714 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d0b4fbd-7a86-45f2-aa70-51932ea2b6ae tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:20.847164 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d0b4fbd-7a86-45f2-aa70-51932ea2b6ae tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:20.851518 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d0b4fbd-7a86-45f2-aa70-51932ea2b6ae tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:20.855033 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d0b4fbd-7a86-45f2-aa70-51932ea2b6ae tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:20.865046 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-5b639b82-febe-415c-97c7-94292ae2a06f tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:20.889185 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5b639b82-febe-415c-97c7-94292ae2a06f tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.787667 Jan 28 00:52:20.908739 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 42/90] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:20 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:21.113559 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9d0b4fbd-7a86-45f2-aa70-51932ea2b6ae tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:21.124850 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9d0b4fbd-7a86-45f2-aa70-51932ea2b6ae tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:21.127354 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9d0b4fbd-7a86-45f2-aa70-51932ea2b6ae tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:21.128683 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9d0b4fbd-7a86-45f2-aa70-51932ea2b6ae tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1407 microversion: 2.20 time: 0.373923 Jan 28 00:52:21.129756 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 49/91] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:20 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1407 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:21.774284 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4c4826e1-581e-48f3-856a-2167cf64c8d2 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:21.775760 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4c4826e1-581e-48f3-856a-2167cf64c8d2 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:21.786121 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c4826e1-581e-48f3-856a-2167cf64c8d2 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:21.786973 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c4826e1-581e-48f3-856a-2167cf64c8d2 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:21.788972 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c4826e1-581e-48f3-856a-2167cf64c8d2 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:21.790131 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c4826e1-581e-48f3-856a-2167cf64c8d2 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:21.975957 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-4de5c3aa-b4e3-485a-8848-a0c4eb38925d req-824b9822-376b-468a-b33a-651f4a75b17f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61b0a08-48a5-4232-a32d-1722b8c8f471", "name": "network-vif-plugged", "status": "completed", "tag": "38b56e7d-5a89-4f34-a8b2-6ae9227cbe25"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:21.979112 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:52:21.979112 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:52:21.989852 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-4de5c3aa-b4e3-485a-8848-a0c4eb38925d req-824b9822-376b-468a-b33a-651f4a75b17f service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:21.991425 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-4de5c3aa-b4e3-485a-8848-a0c4eb38925d req-824b9822-376b-468a-b33a-651f4a75b17f service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:22.010493 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-4de5c3aa-b4e3-485a-8848-a0c4eb38925d req-824b9822-376b-468a-b33a-651f4a75b17f service nova] Creating event network-vif-plugged:38b56e7d-5a89-4f34-a8b2-6ae9227cbe25 for instance a61b0a08-48a5-4232-a32d-1722b8c8f471 on hv-cinder-80952 Jan 28 00:52:22.019149 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-4de5c3aa-b4e3-485a-8848-a0c4eb38925d req-824b9822-376b-468a-b33a-651f4a75b17f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.499868 Jan 28 00:52:22.020742 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 43/92] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:52:22.028134 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1f9287e9-bec7-4579-9a47-988639978fd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:22.029890 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-1f9287e9-bec7-4579-9a47-988639978fd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:22.038037 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1f9287e9-bec7-4579-9a47-988639978fd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:22.039310 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1f9287e9-bec7-4579-9a47-988639978fd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:22.041363 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1f9287e9-bec7-4579-9a47-988639978fd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:22.042534 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1f9287e9-bec7-4579-9a47-988639978fd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:22.072744 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4c4826e1-581e-48f3-856a-2167cf64c8d2 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:22.080629 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4c4826e1-581e-48f3-856a-2167cf64c8d2 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1314 microversion: 2.1 time: 0.310499 Jan 28 00:52:22.081221 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 50/93] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:21 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:22.150215 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-db1eba94-d5b6-4b74-a92a-0e4daf7ecfea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:22.152397 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-db1eba94-d5b6-4b74-a92a-0e4daf7ecfea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:22.162018 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-db1eba94-d5b6-4b74-a92a-0e4daf7ecfea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:22.163155 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-db1eba94-d5b6-4b74-a92a-0e4daf7ecfea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:22.164644 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-db1eba94-d5b6-4b74-a92a-0e4daf7ecfea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:22.165373 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-db1eba94-d5b6-4b74-a92a-0e4daf7ecfea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:22.398672 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-1f9287e9-bec7-4579-9a47-988639978fd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:22.417167 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1f9287e9-bec7-4579-9a47-988639978fd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.393976 Jan 28 00:52:22.433756 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 44/94] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:22 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:22.529727 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-db1eba94-d5b6-4b74-a92a-0e4daf7ecfea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:22.555623 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-db1eba94-d5b6-4b74-a92a-0e4daf7ecfea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:22.557593 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-db1eba94-d5b6-4b74-a92a-0e4daf7ecfea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:22.561077 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-db1eba94-d5b6-4b74-a92a-0e4daf7ecfea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1407 microversion: 2.20 time: 0.413391 Jan 28 00:52:22.566727 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 51/95] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:22 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1407 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:23.107620 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-71eb9d5c-aefd-4efd-8821-8f07076809cc tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:23.108372 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-71eb9d5c-aefd-4efd-8821-8f07076809cc tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:23.114896 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-71eb9d5c-aefd-4efd-8821-8f07076809cc tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:23.116061 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-71eb9d5c-aefd-4efd-8821-8f07076809cc tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:23.117041 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-71eb9d5c-aefd-4efd-8821-8f07076809cc tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:23.117632 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-71eb9d5c-aefd-4efd-8821-8f07076809cc tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:23.300129 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-71eb9d5c-aefd-4efd-8821-8f07076809cc tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:23.310701 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-71eb9d5c-aefd-4efd-8821-8f07076809cc tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1314 microversion: 2.1 time: 0.208055 Jan 28 00:52:23.311814 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 45/96] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:23 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:23.445509 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-07a9f3b7-a23e-416a-b5a3-6ee25c21a652 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:23.446166 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-07a9f3b7-a23e-416a-b5a3-6ee25c21a652 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:23.454594 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-07a9f3b7-a23e-416a-b5a3-6ee25c21a652 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:23.455994 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-07a9f3b7-a23e-416a-b5a3-6ee25c21a652 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:23.457269 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-07a9f3b7-a23e-416a-b5a3-6ee25c21a652 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:23.458090 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-07a9f3b7-a23e-416a-b5a3-6ee25c21a652 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:23.587437 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3b185f29-cfd5-4db9-a754-f0717a7a9974 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:23.587998 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-3b185f29-cfd5-4db9-a754-f0717a7a9974 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:23.600287 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3b185f29-cfd5-4db9-a754-f0717a7a9974 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:23.601034 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3b185f29-cfd5-4db9-a754-f0717a7a9974 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:23.601927 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3b185f29-cfd5-4db9-a754-f0717a7a9974 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:23.604338 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3b185f29-cfd5-4db9-a754-f0717a7a9974 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:24.015543 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-07a9f3b7-a23e-416a-b5a3-6ee25c21a652 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:24.035774 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-3b185f29-cfd5-4db9-a754-f0717a7a9974 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:24.041781 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-07a9f3b7-a23e-416a-b5a3-6ee25c21a652 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.585419 Jan 28 00:52:24.047400 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 52/97] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:23 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:24.048809 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-3b185f29-cfd5-4db9-a754-f0717a7a9974 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:24.050576 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-3b185f29-cfd5-4db9-a754-f0717a7a9974 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:24.052000 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3b185f29-cfd5-4db9-a754-f0717a7a9974 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1407 microversion: 2.20 time: 0.470036 Jan 28 00:52:24.052618 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 46/98] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:23 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1407 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:24.329320 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7d6f60ea-6c83-433d-8018-b0ce198c2fdb tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:24.329947 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7d6f60ea-6c83-433d-8018-b0ce198c2fdb tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:24.346016 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7d6f60ea-6c83-433d-8018-b0ce198c2fdb tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:24.346450 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7d6f60ea-6c83-433d-8018-b0ce198c2fdb tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:24.348458 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7d6f60ea-6c83-433d-8018-b0ce198c2fdb tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:24.349180 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7d6f60ea-6c83-433d-8018-b0ce198c2fdb tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:24.884434 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7d6f60ea-6c83-433d-8018-b0ce198c2fdb tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:24.899629 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7d6f60ea-6c83-433d-8018-b0ce198c2fdb tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1314 microversion: 2.1 time: 0.573660 Jan 28 00:52:24.900512 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 53/99] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:24 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:25.083392 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-66f37347-09e0-4a4e-bfbd-283cb5a58bfb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:25.084362 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-66f37347-09e0-4a4e-bfbd-283cb5a58bfb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:25.086193 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-5950f7b6-a938-41e3-bb55-eb8eb82bcf27 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:25.087055 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-5950f7b6-a938-41e3-bb55-eb8eb82bcf27 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:25.104372 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-66f37347-09e0-4a4e-bfbd-283cb5a58bfb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:25.106302 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5950f7b6-a938-41e3-bb55-eb8eb82bcf27 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:25.106986 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-66f37347-09e0-4a4e-bfbd-283cb5a58bfb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:25.108031 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-66f37347-09e0-4a4e-bfbd-283cb5a58bfb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:25.108706 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5950f7b6-a938-41e3-bb55-eb8eb82bcf27 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:25.109334 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-66f37347-09e0-4a4e-bfbd-283cb5a58bfb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:25.110441 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5950f7b6-a938-41e3-bb55-eb8eb82bcf27 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:25.112102 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5950f7b6-a938-41e3-bb55-eb8eb82bcf27 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:25.510966 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-5950f7b6-a938-41e3-bb55-eb8eb82bcf27 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:25.521159 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-5950f7b6-a938-41e3-bb55-eb8eb82bcf27 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.446950 Jan 28 00:52:25.532619 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 54/100] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:25 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:25.540393 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-66f37347-09e0-4a4e-bfbd-283cb5a58bfb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:25.553146 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-66f37347-09e0-4a4e-bfbd-283cb5a58bfb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:25.555222 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-66f37347-09e0-4a4e-bfbd-283cb5a58bfb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:25.556800 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-66f37347-09e0-4a4e-bfbd-283cb5a58bfb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1407 microversion: 2.20 time: 0.485682 Jan 28 00:52:25.557381 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 47/101] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:25 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1407 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:25.930206 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-52bb0347-f9a9-46fb-b190-ac43c6d8a48e tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:25.931399 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-52bb0347-f9a9-46fb-b190-ac43c6d8a48e tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:25.940788 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-52bb0347-f9a9-46fb-b190-ac43c6d8a48e tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:25.941625 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-52bb0347-f9a9-46fb-b190-ac43c6d8a48e tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:25.942580 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-52bb0347-f9a9-46fb-b190-ac43c6d8a48e tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:25.944389 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-52bb0347-f9a9-46fb-b190-ac43c6d8a48e tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:26.176047 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-52bb0347-f9a9-46fb-b190-ac43c6d8a48e tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:26.187110 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-52bb0347-f9a9-46fb-b190-ac43c6d8a48e tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1314 microversion: 2.1 time: 0.264158 Jan 28 00:52:26.189017 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 55/102] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:25 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:26.503618 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-7d9d9703-bc4b-41f2-b7ed-5f898c353cd1 req-d0394cc4-e410-4309-89ff-d4c0ab579faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f84832-ed83-48ac-a8cb-f3a87abd47bd", "name": "network-vif-plugged", "status": "completed", "tag": "8dcfa13b-a8cd-4dce-8441-ad8f8ab5dda8"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:26.509143 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:52:26.509143 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:52:26.542897 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-62dfab5c-2682-41ff-bcb8-7ddbed9a37d3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:26.544031 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-62dfab5c-2682-41ff-bcb8-7ddbed9a37d3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:26.556870 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-7d9d9703-bc4b-41f2-b7ed-5f898c353cd1 req-d0394cc4-e410-4309-89ff-d4c0ab579faa service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:26.557048 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-62dfab5c-2682-41ff-bcb8-7ddbed9a37d3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:26.557782 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-7d9d9703-bc4b-41f2-b7ed-5f898c353cd1 req-d0394cc4-e410-4309-89ff-d4c0ab579faa service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:26.558345 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-62dfab5c-2682-41ff-bcb8-7ddbed9a37d3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:26.560986 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-62dfab5c-2682-41ff-bcb8-7ddbed9a37d3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:26.561954 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-62dfab5c-2682-41ff-bcb8-7ddbed9a37d3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:26.622729 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-7d9d9703-bc4b-41f2-b7ed-5f898c353cd1 req-d0394cc4-e410-4309-89ff-d4c0ab579faa service nova] Creating event network-vif-plugged:8dcfa13b-a8cd-4dce-8441-ad8f8ab5dda8 for instance 35f84832-ed83-48ac-a8cb-f3a87abd47bd on hv-cinder-80952 Jan 28 00:52:26.642091 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-7d9d9703-bc4b-41f2-b7ed-5f898c353cd1 req-d0394cc4-e410-4309-89ff-d4c0ab579faa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142982 Jan 28 00:52:26.653294 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 48/103] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:52:26.680734 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a578e578-5e2d-4c5b-8a7e-9d92b9a02d5c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:26.706806 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a578e578-5e2d-4c5b-8a7e-9d92b9a02d5c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:26.742897 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a578e578-5e2d-4c5b-8a7e-9d92b9a02d5c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:26.753615 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a578e578-5e2d-4c5b-8a7e-9d92b9a02d5c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:26.755222 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a578e578-5e2d-4c5b-8a7e-9d92b9a02d5c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:26.759916 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a578e578-5e2d-4c5b-8a7e-9d92b9a02d5c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:27.184445 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-62dfab5c-2682-41ff-bcb8-7ddbed9a37d3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:27.198179 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-62dfab5c-2682-41ff-bcb8-7ddbed9a37d3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.661774 Jan 28 00:52:27.202155 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 56/104] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:26 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:27.216024 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-e9d78fd9-1f63-460a-9773-ba6887075523 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:27.217043 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-e9d78fd9-1f63-460a-9773-ba6887075523 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:27.228994 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e9d78fd9-1f63-460a-9773-ba6887075523 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:27.230066 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e9d78fd9-1f63-460a-9773-ba6887075523 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:27.232012 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e9d78fd9-1f63-460a-9773-ba6887075523 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:27.232734 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e9d78fd9-1f63-460a-9773-ba6887075523 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:27.268189 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a578e578-5e2d-4c5b-8a7e-9d92b9a02d5c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:27.288409 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a578e578-5e2d-4c5b-8a7e-9d92b9a02d5c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:27.295174 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a578e578-5e2d-4c5b-8a7e-9d92b9a02d5c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:27.296718 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a578e578-5e2d-4c5b-8a7e-9d92b9a02d5c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1407 microversion: 2.20 time: 0.641459 Jan 28 00:52:27.297518 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 49/105] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:26 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1407 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:27.549486 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-e9d78fd9-1f63-460a-9773-ba6887075523 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:27.587637 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-e9d78fd9-1f63-460a-9773-ba6887075523 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1502 microversion: 2.1 time: 0.379676 Jan 28 00:52:27.589573 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 57/106] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:27 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1502 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:28.228582 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-79b895a3-c1ac-4f9f-86c3-a024e9a4ade1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:28.231561 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-79b895a3-c1ac-4f9f-86c3-a024e9a4ade1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:28.248993 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-79b895a3-c1ac-4f9f-86c3-a024e9a4ade1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:28.251399 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-79b895a3-c1ac-4f9f-86c3-a024e9a4ade1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:28.253804 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-79b895a3-c1ac-4f9f-86c3-a024e9a4ade1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:28.256073 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-79b895a3-c1ac-4f9f-86c3-a024e9a4ade1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:28.319476 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9509d733-38eb-4202-b63c-675cb86a1d00 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:28.321020 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9509d733-38eb-4202-b63c-675cb86a1d00 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:28.338343 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9509d733-38eb-4202-b63c-675cb86a1d00 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:28.341650 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9509d733-38eb-4202-b63c-675cb86a1d00 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:28.343197 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9509d733-38eb-4202-b63c-675cb86a1d00 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:28.345885 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9509d733-38eb-4202-b63c-675cb86a1d00 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:28.638437 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-79b895a3-c1ac-4f9f-86c3-a024e9a4ade1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:28.648911 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-79b895a3-c1ac-4f9f-86c3-a024e9a4ade1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.427762 Jan 28 00:52:28.652398 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 50/107] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:28 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:28.710502 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9509d733-38eb-4202-b63c-675cb86a1d00 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:28.728613 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9509d733-38eb-4202-b63c-675cb86a1d00 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:28.730542 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9509d733-38eb-4202-b63c-675cb86a1d00 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:28.732284 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9509d733-38eb-4202-b63c-675cb86a1d00 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1407 microversion: 2.20 time: 0.419888 Jan 28 00:52:28.734262 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 58/108] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:28 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1407 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:29.675854 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-85e94b15-0afe-4016-bad1-4613a56c139a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:29.675854 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-85e94b15-0afe-4016-bad1-4613a56c139a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:29.687136 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-85e94b15-0afe-4016-bad1-4613a56c139a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:29.687632 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-85e94b15-0afe-4016-bad1-4613a56c139a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:29.688533 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-85e94b15-0afe-4016-bad1-4613a56c139a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:29.688970 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-85e94b15-0afe-4016-bad1-4613a56c139a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:29.751066 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-058f2c99-6c1c-462f-bb84-4ef62e20757b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:29.751723 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-058f2c99-6c1c-462f-bb84-4ef62e20757b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:29.762076 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-058f2c99-6c1c-462f-bb84-4ef62e20757b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:29.762871 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-058f2c99-6c1c-462f-bb84-4ef62e20757b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:29.769976 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-058f2c99-6c1c-462f-bb84-4ef62e20757b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:29.769976 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-058f2c99-6c1c-462f-bb84-4ef62e20757b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:29.976880 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-85e94b15-0afe-4016-bad1-4613a56c139a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:29.985939 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-85e94b15-0afe-4016-bad1-4613a56c139a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.316993 Jan 28 00:52:29.986858 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 51/109] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:29 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:30.111658 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-058f2c99-6c1c-462f-bb84-4ef62e20757b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:30.120604 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-058f2c99-6c1c-462f-bb84-4ef62e20757b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:30.122463 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-058f2c99-6c1c-462f-bb84-4ef62e20757b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:30.123828 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-058f2c99-6c1c-462f-bb84-4ef62e20757b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1407 microversion: 2.20 time: 0.376920 Jan 28 00:52:30.124559 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 59/110] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:29 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1407 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:52:31.016127 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5b0720a7-8c85-48f3-929d-69574079dbf7 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:31.017446 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5b0720a7-8c85-48f3-929d-69574079dbf7 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:31.036802 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5b0720a7-8c85-48f3-929d-69574079dbf7 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:31.038818 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5b0720a7-8c85-48f3-929d-69574079dbf7 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:31.046892 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5b0720a7-8c85-48f3-929d-69574079dbf7 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:31.047724 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5b0720a7-8c85-48f3-929d-69574079dbf7 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:31.143533 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-497035c4-fcd8-4a87-bf22-b3f26bff910a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:31.144847 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-497035c4-fcd8-4a87-bf22-b3f26bff910a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:31.159539 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-497035c4-fcd8-4a87-bf22-b3f26bff910a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:31.162281 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-497035c4-fcd8-4a87-bf22-b3f26bff910a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:31.164255 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-497035c4-fcd8-4a87-bf22-b3f26bff910a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:31.168267 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-497035c4-fcd8-4a87-bf22-b3f26bff910a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:31.335910 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-5b0720a7-8c85-48f3-929d-69574079dbf7 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:31.352954 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5b0720a7-8c85-48f3-929d-69574079dbf7 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.344664 Jan 28 00:52:31.353559 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 52/111] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:31 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:31.523634 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-9ed8c6bd-7e88-4004-b0b7-208701ac4b20 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37506174-6346-401f-8cb4-7f006111fafd"}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:31.525057 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-9ed8c6bd-7e88-4004-b0b7-208701ac4b20 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:31.538699 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9ed8c6bd-7e88-4004-b0b7-208701ac4b20 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:31.541924 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-497035c4-fcd8-4a87-bf22-b3f26bff910a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:31.547622 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9ed8c6bd-7e88-4004-b0b7-208701ac4b20 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:31.548653 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9ed8c6bd-7e88-4004-b0b7-208701ac4b20 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:31.556553 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9ed8c6bd-7e88-4004-b0b7-208701ac4b20 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:31.561139 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-497035c4-fcd8-4a87-bf22-b3f26bff910a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:31.565012 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-497035c4-fcd8-4a87-bf22-b3f26bff910a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:31.567659 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-497035c4-fcd8-4a87-bf22-b3f26bff910a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1407 microversion: 2.20 time: 0.427338 Jan 28 00:52:31.594858 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 60/112] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:31 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1407 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:32.218514 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-9ed8c6bd-7e88-4004-b0b7-208701ac4b20 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "POST /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.701417 Jan 28 00:52:32.222556 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 53/113] 10.222.0.25 () {60 vars in 1322 bytes} [Fri Jan 28 00:52:31 2022] POST /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471/os-volume_attachments => generated 194 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:52:32.375429 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9fb2f2a9-8515-434e-b69f-c726c82f1e42 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:32.376194 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9fb2f2a9-8515-434e-b69f-c726c82f1e42 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:32.383608 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9fb2f2a9-8515-434e-b69f-c726c82f1e42 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:32.384066 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9fb2f2a9-8515-434e-b69f-c726c82f1e42 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:32.384867 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9fb2f2a9-8515-434e-b69f-c726c82f1e42 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:32.385396 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9fb2f2a9-8515-434e-b69f-c726c82f1e42 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:32.545551 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9fb2f2a9-8515-434e-b69f-c726c82f1e42 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:32.558048 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9fb2f2a9-8515-434e-b69f-c726c82f1e42 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.186082 Jan 28 00:52:32.559108 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 61/114] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:32 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:32.595236 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-65aaa2e4-c57d-445d-ac4f-4d219c6ee391 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:32.595975 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-65aaa2e4-c57d-445d-ac4f-4d219c6ee391 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:32.602885 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-65aaa2e4-c57d-445d-ac4f-4d219c6ee391 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:32.603393 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-65aaa2e4-c57d-445d-ac4f-4d219c6ee391 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:32.605184 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-65aaa2e4-c57d-445d-ac4f-4d219c6ee391 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:32.605184 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-65aaa2e4-c57d-445d-ac4f-4d219c6ee391 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:32.753319 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-65aaa2e4-c57d-445d-ac4f-4d219c6ee391 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:32.764134 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-65aaa2e4-c57d-445d-ac4f-4d219c6ee391 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:32.766408 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-65aaa2e4-c57d-445d-ac4f-4d219c6ee391 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:32.768099 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-65aaa2e4-c57d-445d-ac4f-4d219c6ee391 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1407 microversion: 2.20 time: 0.177574 Jan 28 00:52:32.768793 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 54/115] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:32 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:52:33.578240 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-242514b4-7287-4008-adb3-8fb065c5bd59 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:33.581534 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-242514b4-7287-4008-adb3-8fb065c5bd59 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:33.592217 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-242514b4-7287-4008-adb3-8fb065c5bd59 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:33.593121 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-242514b4-7287-4008-adb3-8fb065c5bd59 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:33.593951 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-242514b4-7287-4008-adb3-8fb065c5bd59 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:33.594401 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-242514b4-7287-4008-adb3-8fb065c5bd59 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:33.788898 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7d15f3bb-ac13-4efa-94b3-86c02f5e4b64 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:33.791015 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7d15f3bb-ac13-4efa-94b3-86c02f5e4b64 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:33.800066 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7d15f3bb-ac13-4efa-94b3-86c02f5e4b64 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:33.800926 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7d15f3bb-ac13-4efa-94b3-86c02f5e4b64 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:33.811061 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7d15f3bb-ac13-4efa-94b3-86c02f5e4b64 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:33.811061 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7d15f3bb-ac13-4efa-94b3-86c02f5e4b64 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:33.862819 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-242514b4-7287-4008-adb3-8fb065c5bd59 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:33.887642 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-242514b4-7287-4008-adb3-8fb065c5bd59 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.314588 Jan 28 00:52:33.897654 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 62/116] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:33 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:34.040187 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7d15f3bb-ac13-4efa-94b3-86c02f5e4b64 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:34.055461 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7d15f3bb-ac13-4efa-94b3-86c02f5e4b64 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:34.059542 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7d15f3bb-ac13-4efa-94b3-86c02f5e4b64 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:34.061775 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7d15f3bb-ac13-4efa-94b3-86c02f5e4b64 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1407 microversion: 2.20 time: 0.278939 Jan 28 00:52:34.077686 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 55/117] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:33 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:52:34.912809 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-946d201e-5dbd-4c32-8867-2d9d44acb487 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:34.914085 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-946d201e-5dbd-4c32-8867-2d9d44acb487 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:34.920681 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-946d201e-5dbd-4c32-8867-2d9d44acb487 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:34.921590 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-946d201e-5dbd-4c32-8867-2d9d44acb487 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:34.922407 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-946d201e-5dbd-4c32-8867-2d9d44acb487 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:34.922857 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-946d201e-5dbd-4c32-8867-2d9d44acb487 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:35.086358 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-aa187b49-b419-4558-bb03-f53fe4fa711e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:35.087047 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-aa187b49-b419-4558-bb03-f53fe4fa711e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:35.098752 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-aa187b49-b419-4558-bb03-f53fe4fa711e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:35.100403 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-aa187b49-b419-4558-bb03-f53fe4fa711e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:35.102015 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-aa187b49-b419-4558-bb03-f53fe4fa711e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:35.105205 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-aa187b49-b419-4558-bb03-f53fe4fa711e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:35.136754 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-946d201e-5dbd-4c32-8867-2d9d44acb487 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:35.145480 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-946d201e-5dbd-4c32-8867-2d9d44acb487 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.237955 Jan 28 00:52:35.147417 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 63/118] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:34 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:35.292502 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-aa187b49-b419-4558-bb03-f53fe4fa711e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:35.303987 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-aa187b49-b419-4558-bb03-f53fe4fa711e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:35.305867 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-aa187b49-b419-4558-bb03-f53fe4fa711e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:35.307193 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-aa187b49-b419-4558-bb03-f53fe4fa711e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1407 microversion: 2.20 time: 0.225666 Jan 28 00:52:35.307932 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 56/119] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:35 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:36.017424 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-ddccc4ec-1560-4b12-b52d-cc7ffd6508e1 req-85d2f6b3-f398-4aa9-9d14-1a2c57b122e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4", "name": "network-vif-plugged", "status": "completed", "tag": "83fc2ec7-8030-466d-ac4d-dc369ac1f250"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:36.019385 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:52:36.019385 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:52:36.027720 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-ddccc4ec-1560-4b12-b52d-cc7ffd6508e1 req-85d2f6b3-f398-4aa9-9d14-1a2c57b122e2 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:36.028346 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-ddccc4ec-1560-4b12-b52d-cc7ffd6508e1 req-85d2f6b3-f398-4aa9-9d14-1a2c57b122e2 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:36.041751 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-ddccc4ec-1560-4b12-b52d-cc7ffd6508e1 req-85d2f6b3-f398-4aa9-9d14-1a2c57b122e2 service nova] Creating event network-vif-plugged:83fc2ec7-8030-466d-ac4d-dc369ac1f250 for instance 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 on hv-cinder-80952 Jan 28 00:52:36.047784 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-ddccc4ec-1560-4b12-b52d-cc7ffd6508e1 req-85d2f6b3-f398-4aa9-9d14-1a2c57b122e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034628 Jan 28 00:52:36.048502 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 64/120] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:52:36.167383 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-9a73016d-cbf8-4022-99db-4c8e158997cb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:36.169032 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-9a73016d-cbf8-4022-99db-4c8e158997cb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:36.187990 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9a73016d-cbf8-4022-99db-4c8e158997cb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:36.188581 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9a73016d-cbf8-4022-99db-4c8e158997cb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:36.189788 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9a73016d-cbf8-4022-99db-4c8e158997cb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:36.190689 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9a73016d-cbf8-4022-99db-4c8e158997cb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:36.328893 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-57f55fbd-6053-4fae-941f-667ca49ec487 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:36.330341 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-57f55fbd-6053-4fae-941f-667ca49ec487 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:36.340324 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-57f55fbd-6053-4fae-941f-667ca49ec487 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:36.340324 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-57f55fbd-6053-4fae-941f-667ca49ec487 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:36.340324 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-57f55fbd-6053-4fae-941f-667ca49ec487 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:36.340324 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-57f55fbd-6053-4fae-941f-667ca49ec487 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:36.364182 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-9a73016d-cbf8-4022-99db-4c8e158997cb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:36.377940 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-9a73016d-cbf8-4022-99db-4c8e158997cb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.217629 Jan 28 00:52:36.378913 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 57/121] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:36 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:36.543992 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-57f55fbd-6053-4fae-941f-667ca49ec487 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:36.558744 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-57f55fbd-6053-4fae-941f-667ca49ec487 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:36.562125 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-57f55fbd-6053-4fae-941f-667ca49ec487 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:36.564348 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-57f55fbd-6053-4fae-941f-667ca49ec487 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1407 microversion: 2.20 time: 0.239225 Jan 28 00:52:36.565364 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 65/122] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:36 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:37.412407 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-6e9087c9-095f-4faa-92df-dca78e9f6a52 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:37.413460 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-6e9087c9-095f-4faa-92df-dca78e9f6a52 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:37.423976 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6e9087c9-095f-4faa-92df-dca78e9f6a52 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:37.424446 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6e9087c9-095f-4faa-92df-dca78e9f6a52 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:37.425432 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6e9087c9-095f-4faa-92df-dca78e9f6a52 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:37.425914 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6e9087c9-095f-4faa-92df-dca78e9f6a52 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:37.587382 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-8182effd-80a8-45f9-878b-0c42370951fc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:37.588208 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-8182effd-80a8-45f9-878b-0c42370951fc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:37.597688 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8182effd-80a8-45f9-878b-0c42370951fc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:37.598371 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8182effd-80a8-45f9-878b-0c42370951fc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:37.600158 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8182effd-80a8-45f9-878b-0c42370951fc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:37.600766 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8182effd-80a8-45f9-878b-0c42370951fc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:37.648612 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-6e9087c9-095f-4faa-92df-dca78e9f6a52 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:37.682048 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-6e9087c9-095f-4faa-92df-dca78e9f6a52 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.274723 Jan 28 00:52:37.683137 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 58/123] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:37 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:37.802131 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-8182effd-80a8-45f9-878b-0c42370951fc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:37.810485 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-8182effd-80a8-45f9-878b-0c42370951fc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:37.812056 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-8182effd-80a8-45f9-878b-0c42370951fc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:37.813227 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-8182effd-80a8-45f9-878b-0c42370951fc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1407 microversion: 2.20 time: 0.232226 Jan 28 00:52:37.813809 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 66/124] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:37 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:38.080097 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-3553fee9-1067-4100-aeb1-cf6da6483154 req-fdf85ab5-551d-4905-a9cc-c120b85d639b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e", "name": "network-vif-plugged", "status": "completed", "tag": "e865b513-e08e-40ae-b53a-9cc6744e4709"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:38.084031 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:52:38.084031 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:52:38.102597 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-3553fee9-1067-4100-aeb1-cf6da6483154 req-fdf85ab5-551d-4905-a9cc-c120b85d639b service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:38.104048 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-3553fee9-1067-4100-aeb1-cf6da6483154 req-fdf85ab5-551d-4905-a9cc-c120b85d639b service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:38.123003 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-3553fee9-1067-4100-aeb1-cf6da6483154 req-fdf85ab5-551d-4905-a9cc-c120b85d639b service nova] Creating event network-vif-plugged:e865b513-e08e-40ae-b53a-9cc6744e4709 for instance 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e on hv-cinder-80952 Jan 28 00:52:38.130314 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-3553fee9-1067-4100-aeb1-cf6da6483154 req-fdf85ab5-551d-4905-a9cc-c120b85d639b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057370 Jan 28 00:52:38.131960 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 59/125] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:52:38.714320 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-76a03b3b-cdb6-413a-b30a-0390c5aeb017 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:38.715559 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-76a03b3b-cdb6-413a-b30a-0390c5aeb017 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:38.731133 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-76a03b3b-cdb6-413a-b30a-0390c5aeb017 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:38.731823 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-76a03b3b-cdb6-413a-b30a-0390c5aeb017 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:38.732921 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-76a03b3b-cdb6-413a-b30a-0390c5aeb017 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:38.733892 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-76a03b3b-cdb6-413a-b30a-0390c5aeb017 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:38.842371 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0189da6f-773b-4277-bbef-1e1b7954e73f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:38.843225 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0189da6f-773b-4277-bbef-1e1b7954e73f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:38.869658 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0189da6f-773b-4277-bbef-1e1b7954e73f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:38.870903 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0189da6f-773b-4277-bbef-1e1b7954e73f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:38.873523 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0189da6f-773b-4277-bbef-1e1b7954e73f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:38.876478 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0189da6f-773b-4277-bbef-1e1b7954e73f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:39.150456 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-76a03b3b-cdb6-413a-b30a-0390c5aeb017 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:39.160394 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-76a03b3b-cdb6-413a-b30a-0390c5aeb017 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.454571 Jan 28 00:52:39.161403 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 67/126] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:38 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:39.203794 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-0189da6f-773b-4277-bbef-1e1b7954e73f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:39.221082 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-0189da6f-773b-4277-bbef-1e1b7954e73f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:39.223430 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-0189da6f-773b-4277-bbef-1e1b7954e73f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:39.224866 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0189da6f-773b-4277-bbef-1e1b7954e73f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1599 microversion: 2.20 time: 0.391751 Jan 28 00:52:39.225701 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 60/127] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:52:38 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1599 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:52:39.248333 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1a4767d9-9362-4709-b263-71732d14565f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:39.249772 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1a4767d9-9362-4709-b263-71732d14565f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:39.258782 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1a4767d9-9362-4709-b263-71732d14565f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:39.259598 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1a4767d9-9362-4709-b263-71732d14565f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:39.261015 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1a4767d9-9362-4709-b263-71732d14565f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:39.261870 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1a4767d9-9362-4709-b263-71732d14565f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:39.548866 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1a4767d9-9362-4709-b263-71732d14565f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.307675 Jan 28 00:52:39.550282 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 68/128] 10.222.0.25 () {60 vars in 1315 bytes} [Fri Jan 28 00:52:39 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/os-interface => generated 284 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:52:40.184464 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7fb45e5f-338a-40c6-b1c2-00d953ce94f1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:40.186154 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7fb45e5f-338a-40c6-b1c2-00d953ce94f1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:40.215672 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7fb45e5f-338a-40c6-b1c2-00d953ce94f1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:40.218106 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7fb45e5f-338a-40c6-b1c2-00d953ce94f1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:40.222323 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7fb45e5f-338a-40c6-b1c2-00d953ce94f1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:40.223610 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7fb45e5f-338a-40c6-b1c2-00d953ce94f1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:41.002967 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7fb45e5f-338a-40c6-b1c2-00d953ce94f1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:41.017846 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7fb45e5f-338a-40c6-b1c2-00d953ce94f1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1321 microversion: 2.1 time: 0.837978 Jan 28 00:52:41.031577 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 61/129] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:40 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1321 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:41.877615 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-a8c78ac5-fcfd-421e-9d07-58de2cace162 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:41.878734 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-a8c78ac5-fcfd-421e-9d07-58de2cace162 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:41.902052 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a8c78ac5-fcfd-421e-9d07-58de2cace162 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:41.907212 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a8c78ac5-fcfd-421e-9d07-58de2cace162 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:41.909212 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a8c78ac5-fcfd-421e-9d07-58de2cace162 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:41.912953 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-eac53f4b-446c-44ca-a7fb-f34311dfff5e req-3be475db-1bc9-4b6c-a7d2-39ffefe297b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4", "tag": "83fc2ec7-8030-466d-ac4d-dc369ac1f250"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:41.913411 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a8c78ac5-fcfd-421e-9d07-58de2cace162 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:41.914579 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:52:41.914579 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:52:41.938413 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-eac53f4b-446c-44ca-a7fb-f34311dfff5e req-3be475db-1bc9-4b6c-a7d2-39ffefe297b2 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:41.938862 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-eac53f4b-446c-44ca-a7fb-f34311dfff5e req-3be475db-1bc9-4b6c-a7d2-39ffefe297b2 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:42.016248 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-eac53f4b-446c-44ca-a7fb-f34311dfff5e req-3be475db-1bc9-4b6c-a7d2-39ffefe297b2 service nova] Creating event network-changed:83fc2ec7-8030-466d-ac4d-dc369ac1f250 for instance 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 on hv-cinder-80952 Jan 28 00:52:42.032699 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-eac53f4b-446c-44ca-a7fb-f34311dfff5e req-3be475db-1bc9-4b6c-a7d2-39ffefe297b2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123728 Jan 28 00:52:42.037952 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 62/130] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:52:42.054041 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2b76f456-f289-4f11-8c1f-0e6c2a617f3b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:42.061681 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2b76f456-f289-4f11-8c1f-0e6c2a617f3b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:42.074884 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2b76f456-f289-4f11-8c1f-0e6c2a617f3b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:42.075613 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2b76f456-f289-4f11-8c1f-0e6c2a617f3b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:42.076806 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2b76f456-f289-4f11-8c1f-0e6c2a617f3b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:42.077751 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2b76f456-f289-4f11-8c1f-0e6c2a617f3b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:42.156595 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-a8c78ac5-fcfd-421e-9d07-58de2cace162 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 14 microversion: 2.20 time: 0.283491 Jan 28 00:52:42.161220 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 69/131] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:52:41 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 14 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:42.433481 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-2b76f456-f289-4f11-8c1f-0e6c2a617f3b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:42.452306 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2b76f456-f289-4f11-8c1f-0e6c2a617f3b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1514 microversion: 2.1 time: 0.407826 Jan 28 00:52:42.453265 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 63/132] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:42 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1514 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:42.482786 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3dcc4e4a-fdb7-46e3-ad5c-6c92da09abda tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:42.484924 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3dcc4e4a-fdb7-46e3-ad5c-6c92da09abda tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:42.494803 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3dcc4e4a-fdb7-46e3-ad5c-6c92da09abda tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:42.495421 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3dcc4e4a-fdb7-46e3-ad5c-6c92da09abda tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:42.496530 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3dcc4e4a-fdb7-46e3-ad5c-6c92da09abda tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:42.497251 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3dcc4e4a-fdb7-46e3-ad5c-6c92da09abda tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:42.531553 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.objects.instance [None req-3dcc4e4a-fdb7-46e3-ad5c-6c92da09abda tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lazy-loading 'flavor' on Instance uuid 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e {{(pid=127862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:52:42.846994 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3dcc4e4a-fdb7-46e3-ad5c-6c92da09abda tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "POST /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e/action" status: 200 len: 32 microversion: 2.1 time: 0.369858 Jan 28 00:52:42.851091 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 70/133] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:52:42 2022] POST /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e/action => generated 32 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 00:52:42.863025 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b38b377f-3b75-4210-8fd9-d68136715514 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:42.864620 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b38b377f-3b75-4210-8fd9-d68136715514 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:42.889322 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b38b377f-3b75-4210-8fd9-d68136715514 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:42.892879 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b38b377f-3b75-4210-8fd9-d68136715514 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:42.916410 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b38b377f-3b75-4210-8fd9-d68136715514 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:42.917697 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b38b377f-3b75-4210-8fd9-d68136715514 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:43.169505 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-014237f0-da33-4dea-8002-8c1cbb22fec2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:43.170570 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-014237f0-da33-4dea-8002-8c1cbb22fec2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:43.202761 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-014237f0-da33-4dea-8002-8c1cbb22fec2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:43.204727 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-014237f0-da33-4dea-8002-8c1cbb22fec2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:43.210488 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-014237f0-da33-4dea-8002-8c1cbb22fec2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:43.210488 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-014237f0-da33-4dea-8002-8c1cbb22fec2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:43.479369 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-014237f0-da33-4dea-8002-8c1cbb22fec2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 14 microversion: 2.20 time: 0.314967 Jan 28 00:52:43.481044 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 71/134] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:52:43 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 14 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:43.530292 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b38b377f-3b75-4210-8fd9-d68136715514 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:43.543464 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b38b377f-3b75-4210-8fd9-d68136715514 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.684357 Jan 28 00:52:43.554886 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 64/135] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:42 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:44.493255 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9a96af20-ffb4-4e2a-8ca1-34256082f5ad tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:44.495705 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9a96af20-ffb4-4e2a-8ca1-34256082f5ad tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:44.505222 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9a96af20-ffb4-4e2a-8ca1-34256082f5ad tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:44.506203 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9a96af20-ffb4-4e2a-8ca1-34256082f5ad tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:44.510041 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9a96af20-ffb4-4e2a-8ca1-34256082f5ad tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:44.510041 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9a96af20-ffb4-4e2a-8ca1-34256082f5ad tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:44.561192 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-8dca6602-7dd1-47e9-9866-1dcab2425788 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:44.561813 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-8dca6602-7dd1-47e9-9866-1dcab2425788 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:44.580910 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8dca6602-7dd1-47e9-9866-1dcab2425788 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:44.581364 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8dca6602-7dd1-47e9-9866-1dcab2425788 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:44.582247 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8dca6602-7dd1-47e9-9866-1dcab2425788 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:44.583377 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8dca6602-7dd1-47e9-9866-1dcab2425788 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:44.685338 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9a96af20-ffb4-4e2a-8ca1-34256082f5ad tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 14 microversion: 2.20 time: 0.198477 Jan 28 00:52:44.686854 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 72/136] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:52:44 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:44.879081 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-8dca6602-7dd1-47e9-9866-1dcab2425788 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:44.896041 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-8dca6602-7dd1-47e9-9866-1dcab2425788 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.338405 Jan 28 00:52:44.903887 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 65/137] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:44 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:45.701321 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-911b7128-d1b1-4ca1-b2a9-09ee3f3bb27f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:45.702345 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-911b7128-d1b1-4ca1-b2a9-09ee3f3bb27f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:45.709350 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-911b7128-d1b1-4ca1-b2a9-09ee3f3bb27f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:45.710484 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-911b7128-d1b1-4ca1-b2a9-09ee3f3bb27f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:45.711377 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-911b7128-d1b1-4ca1-b2a9-09ee3f3bb27f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:45.712055 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-911b7128-d1b1-4ca1-b2a9-09ee3f3bb27f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:45.845013 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-274ef55e-1ed1-4b4e-8bab-20d480a79e42 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:45.847844 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-274ef55e-1ed1-4b4e-8bab-20d480a79e42 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:45.854739 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-911b7128-d1b1-4ca1-b2a9-09ee3f3bb27f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 14 microversion: 2.20 time: 0.158340 Jan 28 00:52:45.856237 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 73/138] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:52:45 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:45.869917 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-274ef55e-1ed1-4b4e-8bab-20d480a79e42 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:45.871821 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-274ef55e-1ed1-4b4e-8bab-20d480a79e42 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:45.873932 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-274ef55e-1ed1-4b4e-8bab-20d480a79e42 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:45.875131 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-274ef55e-1ed1-4b4e-8bab-20d480a79e42 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:45.912849 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-274ef55e-1ed1-4b4e-8bab-20d480a79e42 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Going to try to terminate instance {{(pid=127863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 00:52:45.925933 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3da36cdf-603f-4b89-93f9-30c130ae27ff tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:45.927183 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3da36cdf-603f-4b89-93f9-30c130ae27ff tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:45.939543 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3da36cdf-603f-4b89-93f9-30c130ae27ff tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:45.941020 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3da36cdf-603f-4b89-93f9-30c130ae27ff tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:45.946343 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3da36cdf-603f-4b89-93f9-30c130ae27ff tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:45.946890 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3da36cdf-603f-4b89-93f9-30c130ae27ff tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:46.076339 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-274ef55e-1ed1-4b4e-8bab-20d480a79e42 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 204 len: 0 microversion: 2.1 time: 0.239578 Jan 28 00:52:46.077598 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 66/139] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 00:52:45 2022] DELETE /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 00:52:46.125055 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1ed155e9-1fea-4454-a035-f02c645b24fb tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:46.127288 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-1ed155e9-1fea-4454-a035-f02c645b24fb tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:46.151087 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1ed155e9-1fea-4454-a035-f02c645b24fb tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:46.156493 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1ed155e9-1fea-4454-a035-f02c645b24fb tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:46.159937 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1ed155e9-1fea-4454-a035-f02c645b24fb tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:46.162538 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1ed155e9-1fea-4454-a035-f02c645b24fb tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:46.185168 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3da36cdf-603f-4b89-93f9-30c130ae27ff tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:46.196064 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3da36cdf-603f-4b89-93f9-30c130ae27ff tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.275113 Jan 28 00:52:46.214764 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 74/140] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:45 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:46.510414 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-1ed155e9-1fea-4454-a035-f02c645b24fb tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:46.532903 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1ed155e9-1fea-4454-a035-f02c645b24fb tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1554 microversion: 2.1 time: 0.445306 Jan 28 00:52:46.534240 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 67/141] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:46 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1554 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:46.878975 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-5cf16a0b-9631-4422-8c92-10508cc22f9f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:46.881882 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-5cf16a0b-9631-4422-8c92-10508cc22f9f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:46.894199 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5cf16a0b-9631-4422-8c92-10508cc22f9f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:46.895729 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5cf16a0b-9631-4422-8c92-10508cc22f9f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:46.896593 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5cf16a0b-9631-4422-8c92-10508cc22f9f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:46.897095 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5cf16a0b-9631-4422-8c92-10508cc22f9f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:47.078137 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-5cf16a0b-9631-4422-8c92-10508cc22f9f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 14 microversion: 2.20 time: 0.209899 Jan 28 00:52:47.079438 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 75/142] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:52:46 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 14 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:47.226022 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a0bfc546-6465-45ed-94d5-9de836b52b87 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:47.228105 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a0bfc546-6465-45ed-94d5-9de836b52b87 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:47.240831 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a0bfc546-6465-45ed-94d5-9de836b52b87 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:47.241697 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a0bfc546-6465-45ed-94d5-9de836b52b87 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:47.243127 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a0bfc546-6465-45ed-94d5-9de836b52b87 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:47.243954 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a0bfc546-6465-45ed-94d5-9de836b52b87 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:47.538831 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a0bfc546-6465-45ed-94d5-9de836b52b87 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:47.552312 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9ef6b50c-7912-47e0-8f54-12b9088f99b8 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:47.553295 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a0bfc546-6465-45ed-94d5-9de836b52b87 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.336140 Jan 28 00:52:47.553872 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9ef6b50c-7912-47e0-8f54-12b9088f99b8 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:47.554752 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 68/143] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:47 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:47.586341 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9ef6b50c-7912-47e0-8f54-12b9088f99b8 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:47.587508 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9ef6b50c-7912-47e0-8f54-12b9088f99b8 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:47.588793 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9ef6b50c-7912-47e0-8f54-12b9088f99b8 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:47.589423 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9ef6b50c-7912-47e0-8f54-12b9088f99b8 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:47.788879 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9ef6b50c-7912-47e0-8f54-12b9088f99b8 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:47.803558 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9ef6b50c-7912-47e0-8f54-12b9088f99b8 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1554 microversion: 2.1 time: 0.256132 Jan 28 00:52:47.804154 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 76/144] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:47 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1554 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:48.090740 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ed7fa9a5-430e-4819-a1e0-d6bc763a53f1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:48.092078 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ed7fa9a5-430e-4819-a1e0-d6bc763a53f1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:48.117431 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ed7fa9a5-430e-4819-a1e0-d6bc763a53f1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:48.118137 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ed7fa9a5-430e-4819-a1e0-d6bc763a53f1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:48.119795 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ed7fa9a5-430e-4819-a1e0-d6bc763a53f1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:48.120850 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ed7fa9a5-430e-4819-a1e0-d6bc763a53f1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:48.316281 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ed7fa9a5-430e-4819-a1e0-d6bc763a53f1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 14 microversion: 2.20 time: 0.229177 Jan 28 00:52:48.317438 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 69/145] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:52:48 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 14 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:48.573112 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-b9224f31-e577-4bb8-88b8-e9965ac6c296 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:48.573791 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-b9224f31-e577-4bb8-88b8-e9965ac6c296 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:48.581521 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b9224f31-e577-4bb8-88b8-e9965ac6c296 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:48.582237 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b9224f31-e577-4bb8-88b8-e9965ac6c296 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:48.599757 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b9224f31-e577-4bb8-88b8-e9965ac6c296 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:48.600670 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b9224f31-e577-4bb8-88b8-e9965ac6c296 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:48.810449 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-b9224f31-e577-4bb8-88b8-e9965ac6c296 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:48.821190 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-b9224f31-e577-4bb8-88b8-e9965ac6c296 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.251892 Jan 28 00:52:48.822787 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 77/146] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:48 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:48.823021 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-81d46883-36f6-433d-990d-9afa68b59b62 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:48.823683 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-81d46883-36f6-433d-990d-9afa68b59b62 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:48.830806 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-81d46883-36f6-433d-990d-9afa68b59b62 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:48.831772 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-81d46883-36f6-433d-990d-9afa68b59b62 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:48.833455 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-81d46883-36f6-433d-990d-9afa68b59b62 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:48.834433 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-81d46883-36f6-433d-990d-9afa68b59b62 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:49.131378 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-81d46883-36f6-433d-990d-9afa68b59b62 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:49.139827 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-81d46883-36f6-433d-990d-9afa68b59b62 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1554 microversion: 2.1 time: 0.322809 Jan 28 00:52:49.140504 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 70/147] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:48 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1554 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:49.329318 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-a7c7823d-69e3-48ec-b493-c6c78e65ac87 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:49.330908 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-a7c7823d-69e3-48ec-b493-c6c78e65ac87 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:49.346615 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a7c7823d-69e3-48ec-b493-c6c78e65ac87 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:49.347416 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a7c7823d-69e3-48ec-b493-c6c78e65ac87 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:49.355428 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a7c7823d-69e3-48ec-b493-c6c78e65ac87 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:49.357485 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a7c7823d-69e3-48ec-b493-c6c78e65ac87 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:49.524158 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-a7c7823d-69e3-48ec-b493-c6c78e65ac87 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 14 microversion: 2.20 time: 0.199622 Jan 28 00:52:49.528938 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 78/148] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:52:49 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:49.844067 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ac223217-71b0-413d-9e1c-be84cfa68b76 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:49.846090 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ac223217-71b0-413d-9e1c-be84cfa68b76 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:49.859602 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ac223217-71b0-413d-9e1c-be84cfa68b76 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:49.860735 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ac223217-71b0-413d-9e1c-be84cfa68b76 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:49.862394 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ac223217-71b0-413d-9e1c-be84cfa68b76 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:49.863587 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ac223217-71b0-413d-9e1c-be84cfa68b76 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:50.158136 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-da283517-257e-46c7-ab47-7456d48a7266 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:50.158847 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-da283517-257e-46c7-ab47-7456d48a7266 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:50.173767 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-da283517-257e-46c7-ab47-7456d48a7266 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:50.174232 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-da283517-257e-46c7-ab47-7456d48a7266 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:50.175029 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-da283517-257e-46c7-ab47-7456d48a7266 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:50.176431 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-da283517-257e-46c7-ab47-7456d48a7266 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:50.185243 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-ac223217-71b0-413d-9e1c-be84cfa68b76 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:50.208642 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ac223217-71b0-413d-9e1c-be84cfa68b76 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.370664 Jan 28 00:52:50.218249 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 71/149] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:49 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:50.229950 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-9d6e65f1-bc5d-44a3-b310-e30e446b6220 req-0ed6f3b0-c9d9-49be-ab26-f0a57436b376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61b0a08-48a5-4232-a32d-1722b8c8f471", "name": "network-vif-deleted", "tag": "38b56e7d-5a89-4f34-a8b2-6ae9227cbe25"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:50.239598 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:52:50.239598 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:52:50.259191 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-9d6e65f1-bc5d-44a3-b310-e30e446b6220 req-0ed6f3b0-c9d9-49be-ab26-f0a57436b376 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:50.264461 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-9d6e65f1-bc5d-44a3-b310-e30e446b6220 req-0ed6f3b0-c9d9-49be-ab26-f0a57436b376 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:50.290787 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-9d6e65f1-bc5d-44a3-b310-e30e446b6220 req-0ed6f3b0-c9d9-49be-ab26-f0a57436b376 service nova] Creating event network-vif-deleted:38b56e7d-5a89-4f34-a8b2-6ae9227cbe25 for instance a61b0a08-48a5-4232-a32d-1722b8c8f471 on hv-cinder-80952 Jan 28 00:52:50.299958 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-9d6e65f1-bc5d-44a3-b310-e30e446b6220 req-0ed6f3b0-c9d9-49be-ab26-f0a57436b376 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079880 Jan 28 00:52:50.301308 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 72/150] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:52:50.311873 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-da283517-257e-46c7-ab47-7456d48a7266 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:50.325717 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-da283517-257e-46c7-ab47-7456d48a7266 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1512 microversion: 2.1 time: 0.170642 Jan 28 00:52:50.326441 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 79/151] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:50 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:50.538726 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-fd53cd43-101f-40b8-a68b-bdfe22bbbbda tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:50.539835 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-fd53cd43-101f-40b8-a68b-bdfe22bbbbda tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:50.548810 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fd53cd43-101f-40b8-a68b-bdfe22bbbbda tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:50.549284 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fd53cd43-101f-40b8-a68b-bdfe22bbbbda tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:50.550115 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fd53cd43-101f-40b8-a68b-bdfe22bbbbda tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:50.550778 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fd53cd43-101f-40b8-a68b-bdfe22bbbbda tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:50.707159 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-fd53cd43-101f-40b8-a68b-bdfe22bbbbda tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 14 microversion: 2.20 time: 0.174482 Jan 28 00:52:50.710955 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 73/152] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:52:50 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:51.234209 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-75358a82-5238-4d26-a933-5f4f70e15b56 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:51.235024 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-75358a82-5238-4d26-a933-5f4f70e15b56 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:51.242941 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-75358a82-5238-4d26-a933-5f4f70e15b56 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:51.243824 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-75358a82-5238-4d26-a933-5f4f70e15b56 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:51.245341 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-75358a82-5238-4d26-a933-5f4f70e15b56 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:51.246790 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-75358a82-5238-4d26-a933-5f4f70e15b56 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:51.357106 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f1dc4c91-1923-47b2-b0a0-50bc6a0b2923 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:51.358294 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f1dc4c91-1923-47b2-b0a0-50bc6a0b2923 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:51.382971 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f1dc4c91-1923-47b2-b0a0-50bc6a0b2923 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:51.384754 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f1dc4c91-1923-47b2-b0a0-50bc6a0b2923 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:51.386903 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f1dc4c91-1923-47b2-b0a0-50bc6a0b2923 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:51.388875 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f1dc4c91-1923-47b2-b0a0-50bc6a0b2923 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:51.451326 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f1dc4c91-1923-47b2-b0a0-50bc6a0b2923 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:51.452229 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f1dc4c91-1923-47b2-b0a0-50bc6a0b2923 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:51.452939 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.objects.instance [None req-f1dc4c91-1923-47b2-b0a0-50bc6a0b2923 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lazy-loading 'fault' on Instance uuid a61b0a08-48a5-4232-a32d-1722b8c8f471 {{(pid=127863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:52:51.536728 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f1dc4c91-1923-47b2-b0a0-50bc6a0b2923 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a06525ba694c4151a57ebb700ff967f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3084946f74c3454cb750fe1c88cf6092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:51.537353 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-75358a82-5238-4d26-a933-5f4f70e15b56 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:51.546384 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-75358a82-5238-4d26-a933-5f4f70e15b56 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.315722 Jan 28 00:52:51.549235 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f1dc4c91-1923-47b2-b0a0-50bc6a0b2923 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 200 len: 1350 microversion: 2.1 time: 0.206184 Jan 28 00:52:51.553984 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 74/153] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:51 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 1350 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:51.557365 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 80/154] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:51 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:51.745888 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5adb4d8e-068e-4366-8dde-d69a129c7103 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:51.752662 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5adb4d8e-068e-4366-8dde-d69a129c7103 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:51.783674 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5adb4d8e-068e-4366-8dde-d69a129c7103 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:51.787099 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5adb4d8e-068e-4366-8dde-d69a129c7103 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:51.788957 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5adb4d8e-068e-4366-8dde-d69a129c7103 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:51.792801 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5adb4d8e-068e-4366-8dde-d69a129c7103 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:51.964604 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5adb4d8e-068e-4366-8dde-d69a129c7103 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 14 microversion: 2.20 time: 0.247837 Jan 28 00:52:51.965265 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 75/155] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:52:51 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 14 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:52.572011 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-c2160463-46f4-43ac-b270-7226ca13e29c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:52.572669 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-c2160463-46f4-43ac-b270-7226ca13e29c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:52.574282 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-6b6722da-0229-45d8-9603-640a0c1512f6 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:52.575112 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-6b6722da-0229-45d8-9603-640a0c1512f6 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:52.599377 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c2160463-46f4-43ac-b270-7226ca13e29c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:52.599377 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c2160463-46f4-43ac-b270-7226ca13e29c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:52.605516 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6b6722da-0229-45d8-9603-640a0c1512f6 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:52.606002 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6b6722da-0229-45d8-9603-640a0c1512f6 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:52.608642 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c2160463-46f4-43ac-b270-7226ca13e29c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:52.608953 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c2160463-46f4-43ac-b270-7226ca13e29c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:52.614223 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6b6722da-0229-45d8-9603-640a0c1512f6 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:52.614792 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6b6722da-0229-45d8-9603-640a0c1512f6 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:52.672295 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-6b6722da-0229-45d8-9603-640a0c1512f6 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] HTTP exception thrown: Instance a61b0a08-48a5-4232-a32d-1722b8c8f471 could not be found. Jan 28 00:52:52.674475 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-6b6722da-0229-45d8-9603-640a0c1512f6 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Returning 404 to user: Instance a61b0a08-48a5-4232-a32d-1722b8c8f471 could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:52:52.675559 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-6b6722da-0229-45d8-9603-640a0c1512f6 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 404 len: 111 microversion: 2.1 time: 0.108964 Jan 28 00:52:52.684817 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 76/156] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:52 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 00:52:52.976674 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ec8358ef-c128-44f1-a05b-c34d907b1163 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:52.978715 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ec8358ef-c128-44f1-a05b-c34d907b1163 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:52.996089 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ec8358ef-c128-44f1-a05b-c34d907b1163 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:52.998704 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ec8358ef-c128-44f1-a05b-c34d907b1163 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:53.002029 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ec8358ef-c128-44f1-a05b-c34d907b1163 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:53.004893 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ec8358ef-c128-44f1-a05b-c34d907b1163 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:53.045482 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c2160463-46f4-43ac-b270-7226ca13e29c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:53.060018 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-c2160463-46f4-43ac-b270-7226ca13e29c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.498803 Jan 28 00:52:53.060623 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 81/157] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:52 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:53.221592 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-20f819db-5627-4a57-8164-2cb15423b3f3 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:53.222715 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-20f819db-5627-4a57-8164-2cb15423b3f3 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:53.228839 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ec8358ef-c128-44f1-a05b-c34d907b1163 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 14 microversion: 2.20 time: 0.256322 Jan 28 00:52:53.229924 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 77/158] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:52:52 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 14 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:53.234874 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-20f819db-5627-4a57-8164-2cb15423b3f3 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:53.237023 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-20f819db-5627-4a57-8164-2cb15423b3f3 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:53.240267 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-20f819db-5627-4a57-8164-2cb15423b3f3 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:53.240758 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-20f819db-5627-4a57-8164-2cb15423b3f3 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:53.263525 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-20f819db-5627-4a57-8164-2cb15423b3f3 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] HTTP exception thrown: Instance a61b0a08-48a5-4232-a32d-1722b8c8f471 could not be found. Jan 28 00:52:53.264139 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-20f819db-5627-4a57-8164-2cb15423b3f3 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Returning 404 to user: Instance a61b0a08-48a5-4232-a32d-1722b8c8f471 could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:52:53.265436 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-20f819db-5627-4a57-8164-2cb15423b3f3 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047665 Jan 28 00:52:53.266014 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 82/159] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 00:52:53 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 00:52:54.078464 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1c1b4404-7497-4cac-95ba-a94ba7342e85 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:54.079956 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-1c1b4404-7497-4cac-95ba-a94ba7342e85 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:54.087944 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1c1b4404-7497-4cac-95ba-a94ba7342e85 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:54.088370 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1c1b4404-7497-4cac-95ba-a94ba7342e85 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:54.089103 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1c1b4404-7497-4cac-95ba-a94ba7342e85 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:54.089540 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1c1b4404-7497-4cac-95ba-a94ba7342e85 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:54.242105 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-03649de3-eba5-4c21-b127-e41ca82c31ec tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:54.243157 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-03649de3-eba5-4c21-b127-e41ca82c31ec tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:54.252897 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-03649de3-eba5-4c21-b127-e41ca82c31ec tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:54.253685 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-03649de3-eba5-4c21-b127-e41ca82c31ec tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:54.255988 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-03649de3-eba5-4c21-b127-e41ca82c31ec tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:54.256285 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-03649de3-eba5-4c21-b127-e41ca82c31ec tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:54.266505 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-1c1b4404-7497-4cac-95ba-a94ba7342e85 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:54.276528 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1c1b4404-7497-4cac-95ba-a94ba7342e85 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.202266 Jan 28 00:52:54.289164 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 78/160] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:54 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:54.366337 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-03649de3-eba5-4c21-b127-e41ca82c31ec tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 14 microversion: 2.20 time: 0.128401 Jan 28 00:52:54.367085 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 83/161] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:52:54 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:52:55.141663 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-af81b22d-4014-4f9f-9612-44ef353de0b1 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-109682955", "imageRef": "7fe09c59-2ff9-4639-b39d-9a474e83ad91", "flavorRef": "452", "networks": [{"uuid": "2ecb06c8-0460-4a10-8a76-6c7f66642518"}]}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:55.215841 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.network.neutron [None req-af81b22d-4014-4f9f-9612-44ef353de0b1 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] validate_networks() for [('2ecb06c8-0460-4a10-8a76-6c7f66642518', None, None, None, None, None)] {{(pid=127863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:52:55.308196 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-107d80eb-86bb-45c5-925d-5a3c5d6efebb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:55.309908 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-107d80eb-86bb-45c5-925d-5a3c5d6efebb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:55.324862 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-107d80eb-86bb-45c5-925d-5a3c5d6efebb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:55.326231 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-107d80eb-86bb-45c5-925d-5a3c5d6efebb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:55.327997 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-107d80eb-86bb-45c5-925d-5a3c5d6efebb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:55.328991 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-107d80eb-86bb-45c5-925d-5a3c5d6efebb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:55.656400 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-107d80eb-86bb-45c5-925d-5a3c5d6efebb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:55.665042 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-107d80eb-86bb-45c5-925d-5a3c5d6efebb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.368176 Jan 28 00:52:55.666316 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 84/162] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:55 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:55.672197 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4bba12b8-9aff-4017-a1b3-bb6bcb3668e0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:55.673373 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4bba12b8-9aff-4017-a1b3-bb6bcb3668e0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:55.687127 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4bba12b8-9aff-4017-a1b3-bb6bcb3668e0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:55.687986 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4bba12b8-9aff-4017-a1b3-bb6bcb3668e0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:55.688880 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4bba12b8-9aff-4017-a1b3-bb6bcb3668e0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:55.689402 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4bba12b8-9aff-4017-a1b3-bb6bcb3668e0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:55.875525 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-af81b22d-4014-4f9f-9612-44ef353de0b1 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Flavor limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:52:55.876080 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-af81b22d-4014-4f9f-9612-44ef353de0b1 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Image limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:52:55.876633 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-af81b22d-4014-4f9f-9612-44ef353de0b1 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Flavor pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:52:55.876830 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-af81b22d-4014-4f9f-9612-44ef353de0b1 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Image pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:52:55.877335 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-af81b22d-4014-4f9f-9612-44ef353de0b1 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:52:55.889698 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-af81b22d-4014-4f9f-9612-44ef353de0b1 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:55.890660 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-af81b22d-4014-4f9f-9612-44ef353de0b1 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:55.892082 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-af81b22d-4014-4f9f-9612-44ef353de0b1 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:55.892876 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-af81b22d-4014-4f9f-9612-44ef353de0b1 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:55.918792 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-af81b22d-4014-4f9f-9612-44ef353de0b1 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Getting quotas for project 88c2482fcb9c4c6197bf49eb103a1623. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:52:55.923936 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-af81b22d-4014-4f9f-9612-44ef353de0b1 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Getting quotas for user ba8966bcdbbc4e2e8d21a7a917c54108 and project 88c2482fcb9c4c6197bf49eb103a1623. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:52:55.944655 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-af81b22d-4014-4f9f-9612-44ef353de0b1 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Going to run 1 instances... {{(pid=127863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:52:55.947561 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-af81b22d-4014-4f9f-9612-44ef353de0b1 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fe09c59-2ff9-4639-b39d-9a474e83ad91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:52:56.005283 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-af81b22d-4014-4f9f-9612-44ef353de0b1 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870178 Jan 28 00:52:56.006134 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 79/163] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 00:52:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 00:52:56.020938 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b8370466-447e-403b-ba94-1a6c5b671e79 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:56.021765 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b8370466-447e-403b-ba94-1a6c5b671e79 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:56.042708 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4bba12b8-9aff-4017-a1b3-bb6bcb3668e0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 14 microversion: 2.20 time: 0.373714 Jan 28 00:52:56.044229 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 85/164] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:52:55 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 14 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:56.058774 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7d866472-c434-451b-949b-dcd9b08fcc78 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:56.059555 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7d866472-c434-451b-949b-dcd9b08fcc78 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:56.178680 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7d866472-c434-451b-949b-dcd9b08fcc78 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:56.188326 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7d866472-c434-451b-949b-dcd9b08fcc78 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6" status: 200 len: 1218 microversion: 2.1 time: 0.142124 Jan 28 00:52:56.189867 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 86/165] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:56 2022] GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6 => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:56.199814 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b8370466-447e-403b-ba94-1a6c5b671e79 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:56.200320 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b8370466-447e-403b-ba94-1a6c5b671e79 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:56.201345 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b8370466-447e-403b-ba94-1a6c5b671e79 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:56.203563 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b8370466-447e-403b-ba94-1a6c5b671e79 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:56.220130 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-b8370466-447e-403b-ba94-1a6c5b671e79 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] HTTP exception thrown: Instance a61b0a08-48a5-4232-a32d-1722b8c8f471 could not be found. Jan 28 00:52:56.220891 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b8370466-447e-403b-ba94-1a6c5b671e79 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Returning 404 to user: Instance a61b0a08-48a5-4232-a32d-1722b8c8f471 could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:52:56.221929 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b8370466-447e-403b-ba94-1a6c5b671e79 tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 404 len: 111 microversion: 2.1 time: 0.206401 Jan 28 00:52:56.222813 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 80/166] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 00:52:56 2022] DELETE /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:52:56.232312 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-57ccbf1f-5183-494e-b8e3-355699b0028c tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:56.233471 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-57ccbf1f-5183-494e-b8e3-355699b0028c tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] [instance: a61b0a08-48a5-4232-a32d-1722b8c8f471] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:56.247060 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-57ccbf1f-5183-494e-b8e3-355699b0028c tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:56.247694 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-57ccbf1f-5183-494e-b8e3-355699b0028c tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:56.248552 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-57ccbf1f-5183-494e-b8e3-355699b0028c tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:56.249187 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-57ccbf1f-5183-494e-b8e3-355699b0028c tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:56.268699 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-57ccbf1f-5183-494e-b8e3-355699b0028c tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] HTTP exception thrown: Instance a61b0a08-48a5-4232-a32d-1722b8c8f471 could not be found. Jan 28 00:52:56.270996 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-57ccbf1f-5183-494e-b8e3-355699b0028c tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] Returning 404 to user: Instance a61b0a08-48a5-4232-a32d-1722b8c8f471 could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:52:56.272774 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-57ccbf1f-5183-494e-b8e3-355699b0028c tempest-DeleteServersTestJSON-1984619940 tempest-DeleteServersTestJSON-1984619940-project] 10.222.0.25 "GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471" status: 404 len: 111 microversion: 2.1 time: 0.045388 Jan 28 00:52:56.274024 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 87/167] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:56 2022] GET /compute/v2.1/servers/a61b0a08-48a5-4232-a32d-1722b8c8f471 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:52:56.698198 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e4f9c2b3-5dd2-4dd4-acff-6263119f3ff4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:56.699377 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e4f9c2b3-5dd2-4dd4-acff-6263119f3ff4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:56.715416 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e4f9c2b3-5dd2-4dd4-acff-6263119f3ff4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:56.716915 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e4f9c2b3-5dd2-4dd4-acff-6263119f3ff4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:56.718354 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e4f9c2b3-5dd2-4dd4-acff-6263119f3ff4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:56.719143 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e4f9c2b3-5dd2-4dd4-acff-6263119f3ff4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:57.006630 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e4f9c2b3-5dd2-4dd4-acff-6263119f3ff4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:57.015228 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e4f9c2b3-5dd2-4dd4-acff-6263119f3ff4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.334454 Jan 28 00:52:57.015920 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 81/168] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:56 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:57.064851 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-a86940f6-5eb9-4170-afb8-cb3d5acf0ab4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:57.067669 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-a86940f6-5eb9-4170-afb8-cb3d5acf0ab4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:57.075164 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a86940f6-5eb9-4170-afb8-cb3d5acf0ab4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:57.076024 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a86940f6-5eb9-4170-afb8-cb3d5acf0ab4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:57.077082 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a86940f6-5eb9-4170-afb8-cb3d5acf0ab4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:57.077617 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a86940f6-5eb9-4170-afb8-cb3d5acf0ab4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:57.180519 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-a86940f6-5eb9-4170-afb8-cb3d5acf0ab4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 14 microversion: 2.20 time: 0.126593 Jan 28 00:52:57.181916 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 88/169] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:52:57 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:57.209614 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f30e98eb-0eb7-4a3c-9e78-d3b8d95eeec6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:57.210232 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f30e98eb-0eb7-4a3c-9e78-d3b8d95eeec6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:57.216449 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f30e98eb-0eb7-4a3c-9e78-d3b8d95eeec6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:57.217292 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f30e98eb-0eb7-4a3c-9e78-d3b8d95eeec6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:57.218262 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f30e98eb-0eb7-4a3c-9e78-d3b8d95eeec6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:57.218705 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f30e98eb-0eb7-4a3c-9e78-d3b8d95eeec6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:57.306012 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f30e98eb-0eb7-4a3c-9e78-d3b8d95eeec6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:57.314907 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f30e98eb-0eb7-4a3c-9e78-d3b8d95eeec6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6" status: 200 len: 1270 microversion: 2.1 time: 0.109525 Jan 28 00:52:57.315710 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 82/170] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:57 2022] GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6 => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:58.037254 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-297734c7-99ca-4d60-9a95-4047859c4f88 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:58.038128 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-297734c7-99ca-4d60-9a95-4047859c4f88 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:58.047195 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-297734c7-99ca-4d60-9a95-4047859c4f88 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:58.048056 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-297734c7-99ca-4d60-9a95-4047859c4f88 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:58.049122 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-297734c7-99ca-4d60-9a95-4047859c4f88 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:58.049870 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-297734c7-99ca-4d60-9a95-4047859c4f88 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:58.194869 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-21a94c0f-d23d-4b99-8e4d-e69f59a28b9a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:58.198201 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-21a94c0f-d23d-4b99-8e4d-e69f59a28b9a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:58.214918 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-21a94c0f-d23d-4b99-8e4d-e69f59a28b9a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:58.215620 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-21a94c0f-d23d-4b99-8e4d-e69f59a28b9a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:58.220583 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-21a94c0f-d23d-4b99-8e4d-e69f59a28b9a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:58.220583 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-21a94c0f-d23d-4b99-8e4d-e69f59a28b9a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:58.352867 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-297734c7-99ca-4d60-9a95-4047859c4f88 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:58.359506 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-297734c7-99ca-4d60-9a95-4047859c4f88 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.329600 Jan 28 00:52:58.360196 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 89/171] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:58 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:58.367847 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-10e2a8e8-bb94-4089-9879-03285e647b24 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:58.368625 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-10e2a8e8-bb94-4089-9879-03285e647b24 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:58.376131 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-10e2a8e8-bb94-4089-9879-03285e647b24 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:58.376595 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-10e2a8e8-bb94-4089-9879-03285e647b24 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:58.377425 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-10e2a8e8-bb94-4089-9879-03285e647b24 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:58.377856 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-10e2a8e8-bb94-4089-9879-03285e647b24 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:58.385437 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-21a94c0f-d23d-4b99-8e4d-e69f59a28b9a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 2137 microversion: 2.20 time: 0.196246 Jan 28 00:52:58.386530 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 83/172] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:52:58 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 2137 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:52:58.496377 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-10e2a8e8-bb94-4089-9879-03285e647b24 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:58.505868 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-10e2a8e8-bb94-4089-9879-03285e647b24 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6" status: 200 len: 1276 microversion: 2.1 time: 0.144548 Jan 28 00:52:58.506607 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 90/173] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:58 2022] GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6 => generated 1276 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:52:59.378551 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0e56ece1-86c7-4484-8fca-e90f226a3199 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:59.380147 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0e56ece1-86c7-4484-8fca-e90f226a3199 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:59.396811 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0e56ece1-86c7-4484-8fca-e90f226a3199 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:59.397449 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0e56ece1-86c7-4484-8fca-e90f226a3199 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:59.398484 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-04821f03-1321-46d7-a053-682f25b50bff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:52:59.399501 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-04821f03-1321-46d7-a053-682f25b50bff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:59.400318 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0e56ece1-86c7-4484-8fca-e90f226a3199 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:59.403538 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0e56ece1-86c7-4484-8fca-e90f226a3199 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:59.412552 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-04821f03-1321-46d7-a053-682f25b50bff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:59.413007 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-04821f03-1321-46d7-a053-682f25b50bff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:59.416714 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-04821f03-1321-46d7-a053-682f25b50bff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:59.417732 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-04821f03-1321-46d7-a053-682f25b50bff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:59.568533 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-04821f03-1321-46d7-a053-682f25b50bff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 9847 microversion: 2.20 time: 0.174060 Jan 28 00:52:59.569938 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 91/174] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:52:59 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 9847 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:52:59.577778 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ac01b253-5555-433c-8761-78736d51c3aa tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:52:59.578960 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ac01b253-5555-433c-8761-78736d51c3aa tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:52:59.588909 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ac01b253-5555-433c-8761-78736d51c3aa tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:59.590305 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ac01b253-5555-433c-8761-78736d51c3aa tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:59.591376 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ac01b253-5555-433c-8761-78736d51c3aa tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:52:59.592661 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ac01b253-5555-433c-8761-78736d51c3aa tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:52:59.769459 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-0e56ece1-86c7-4484-8fca-e90f226a3199 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:52:59.790585 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0e56ece1-86c7-4484-8fca-e90f226a3199 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.416784 Jan 28 00:52:59.791490 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 84/175] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:59 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:00.021574 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ac01b253-5555-433c-8761-78736d51c3aa tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:00.034042 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ac01b253-5555-433c-8761-78736d51c3aa tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6" status: 200 len: 1318 microversion: 2.1 time: 0.462402 Jan 28 00:53:00.060323 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 92/176] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:52:59 2022] GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:00.219118 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-d80d6cfc-a426-4b19-8ea8-bd99199fd4ec req-c9e855f4-2bc8-48b5-90fe-6eaeb16ddbde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b14e9c4-567f-45aa-942a-1acae5d9eff6", "tag": "d25cd54a-55bc-4938-b4e0-1fb9bfa8d8f0"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:00.221111 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:53:00.221111 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:53:00.235982 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-d80d6cfc-a426-4b19-8ea8-bd99199fd4ec req-c9e855f4-2bc8-48b5-90fe-6eaeb16ddbde service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:00.241229 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-d80d6cfc-a426-4b19-8ea8-bd99199fd4ec req-c9e855f4-2bc8-48b5-90fe-6eaeb16ddbde service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:00.270459 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-d80d6cfc-a426-4b19-8ea8-bd99199fd4ec req-c9e855f4-2bc8-48b5-90fe-6eaeb16ddbde service nova] Creating event network-changed:d25cd54a-55bc-4938-b4e0-1fb9bfa8d8f0 for instance 4b14e9c4-567f-45aa-942a-1acae5d9eff6 on hv-cinder-80952 Jan 28 00:53:00.293165 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-d80d6cfc-a426-4b19-8ea8-bd99199fd4ec req-c9e855f4-2bc8-48b5-90fe-6eaeb16ddbde service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078620 Jan 28 00:53:00.295669 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 85/177] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:53:00.588632 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d7c31a98-1db5-4921-adeb-cc4ac97d0222 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:00.592796 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d7c31a98-1db5-4921-adeb-cc4ac97d0222 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:00.640459 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d7c31a98-1db5-4921-adeb-cc4ac97d0222 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:00.641602 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d7c31a98-1db5-4921-adeb-cc4ac97d0222 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:00.643344 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d7c31a98-1db5-4921-adeb-cc4ac97d0222 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:00.645653 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d7c31a98-1db5-4921-adeb-cc4ac97d0222 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:00.811452 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1b38bf47-947c-4d8b-a836-57919eaa39a4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:00.813188 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-1b38bf47-947c-4d8b-a836-57919eaa39a4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:00.825317 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d7c31a98-1db5-4921-adeb-cc4ac97d0222 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 15025 microversion: 2.20 time: 0.244964 Jan 28 00:53:00.826636 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 93/178] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:00 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 15025 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:00.828301 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1b38bf47-947c-4d8b-a836-57919eaa39a4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:00.829055 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1b38bf47-947c-4d8b-a836-57919eaa39a4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:00.830224 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1b38bf47-947c-4d8b-a836-57919eaa39a4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:00.832519 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1b38bf47-947c-4d8b-a836-57919eaa39a4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:01.081420 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-398a6e7c-5983-4ebb-a149-c9d74cba5843 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:01.083115 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-398a6e7c-5983-4ebb-a149-c9d74cba5843 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:01.100063 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-398a6e7c-5983-4ebb-a149-c9d74cba5843 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:01.100526 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-398a6e7c-5983-4ebb-a149-c9d74cba5843 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:01.101347 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-398a6e7c-5983-4ebb-a149-c9d74cba5843 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:01.101795 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-398a6e7c-5983-4ebb-a149-c9d74cba5843 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:01.397507 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-1b38bf47-947c-4d8b-a836-57919eaa39a4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:01.434738 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1b38bf47-947c-4d8b-a836-57919eaa39a4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.626344 Jan 28 00:53:01.437013 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 86/179] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:00 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:01.837665 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-398a6e7c-5983-4ebb-a149-c9d74cba5843 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:01.845980 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-8fdf69b9-ddec-48dc-968e-027a7e7a9320 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:01.846701 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-398a6e7c-5983-4ebb-a149-c9d74cba5843 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6" status: 200 len: 1318 microversion: 2.1 time: 0.780531 Jan 28 00:53:01.857495 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-8fdf69b9-ddec-48dc-968e-027a7e7a9320 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:01.859343 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 94/180] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:01 2022] GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6 => generated 1318 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:01.880800 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8fdf69b9-ddec-48dc-968e-027a7e7a9320 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:01.882620 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8fdf69b9-ddec-48dc-968e-027a7e7a9320 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:01.883678 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8fdf69b9-ddec-48dc-968e-027a7e7a9320 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:01.884282 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8fdf69b9-ddec-48dc-968e-027a7e7a9320 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:02.013879 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-8fdf69b9-ddec-48dc-968e-027a7e7a9320 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 18208 microversion: 2.20 time: 0.178939 Jan 28 00:53:02.019118 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 87/181] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:01 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 18208 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:02.460172 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-a636ded9-dd90-4ec2-bd27-510269ab8f33 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:02.461661 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-a636ded9-dd90-4ec2-bd27-510269ab8f33 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:02.488820 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a636ded9-dd90-4ec2-bd27-510269ab8f33 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:02.490013 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a636ded9-dd90-4ec2-bd27-510269ab8f33 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:02.491729 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a636ded9-dd90-4ec2-bd27-510269ab8f33 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:02.494699 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a636ded9-dd90-4ec2-bd27-510269ab8f33 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:02.824330 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-a636ded9-dd90-4ec2-bd27-510269ab8f33 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:02.841457 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-a636ded9-dd90-4ec2-bd27-510269ab8f33 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.389763 Jan 28 00:53:02.845116 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 95/182] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:02 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:02.867362 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-fae98b87-e7bd-41d4-bb57-07e2fde50673 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:02.868098 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-fae98b87-e7bd-41d4-bb57-07e2fde50673 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:02.880417 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fae98b87-e7bd-41d4-bb57-07e2fde50673 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:02.893702 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fae98b87-e7bd-41d4-bb57-07e2fde50673 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:02.896309 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fae98b87-e7bd-41d4-bb57-07e2fde50673 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:02.896655 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fae98b87-e7bd-41d4-bb57-07e2fde50673 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:03.027311 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-91e0b096-cb38-4c32-9f81-ef35f6e95123 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:03.028678 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-91e0b096-cb38-4c32-9f81-ef35f6e95123 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:03.035704 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-91e0b096-cb38-4c32-9f81-ef35f6e95123 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:03.040755 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-91e0b096-cb38-4c32-9f81-ef35f6e95123 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:03.043673 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-91e0b096-cb38-4c32-9f81-ef35f6e95123 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:03.044585 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-91e0b096-cb38-4c32-9f81-ef35f6e95123 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:03.207676 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-91e0b096-cb38-4c32-9f81-ef35f6e95123 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 19024 microversion: 2.20 time: 0.183410 Jan 28 00:53:03.208757 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 96/183] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:03 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 19024 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:03.276684 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-fae98b87-e7bd-41d4-bb57-07e2fde50673 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:03.297276 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-fae98b87-e7bd-41d4-bb57-07e2fde50673 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6" status: 200 len: 1318 microversion: 2.1 time: 0.437348 Jan 28 00:53:03.317356 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 88/184] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:02 2022] GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6 => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:03.864885 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-a9b95602-e7c3-4c46-8656-52e0121d7664 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:03.865631 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-a9b95602-e7c3-4c46-8656-52e0121d7664 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:03.888083 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a9b95602-e7c3-4c46-8656-52e0121d7664 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:03.888474 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a9b95602-e7c3-4c46-8656-52e0121d7664 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:03.892339 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a9b95602-e7c3-4c46-8656-52e0121d7664 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:03.895746 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a9b95602-e7c3-4c46-8656-52e0121d7664 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:04.224190 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-461dab6e-5697-4502-9120-f5aa8da4515b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:04.227423 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-461dab6e-5697-4502-9120-f5aa8da4515b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:04.254523 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-461dab6e-5697-4502-9120-f5aa8da4515b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:04.255228 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-461dab6e-5697-4502-9120-f5aa8da4515b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:04.256371 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-461dab6e-5697-4502-9120-f5aa8da4515b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:04.256984 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-461dab6e-5697-4502-9120-f5aa8da4515b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:04.402074 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-461dab6e-5697-4502-9120-f5aa8da4515b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 20985 microversion: 2.20 time: 0.185581 Jan 28 00:53:04.403506 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 89/185] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:04 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 20985 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:04.418721 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2d520bb3-d984-4761-b9e9-37d837035128 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:04.420282 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2d520bb3-d984-4761-b9e9-37d837035128 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:04.429244 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2d520bb3-d984-4761-b9e9-37d837035128 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:04.430058 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2d520bb3-d984-4761-b9e9-37d837035128 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:04.434292 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2d520bb3-d984-4761-b9e9-37d837035128 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:04.434998 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2d520bb3-d984-4761-b9e9-37d837035128 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:04.639567 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-a9b95602-e7c3-4c46-8656-52e0121d7664 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:04.655152 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-a9b95602-e7c3-4c46-8656-52e0121d7664 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.796628 Jan 28 00:53:04.660237 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 97/186] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:03 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:05.161104 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-2d520bb3-d984-4761-b9e9-37d837035128 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:05.171847 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2d520bb3-d984-4761-b9e9-37d837035128 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6" status: 200 len: 1318 microversion: 2.1 time: 0.766827 Jan 28 00:53:05.174966 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 90/187] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:04 2022] GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6 => generated 1318 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:05.419882 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9f66b9d9-44b6-43b6-8aa2-bf21861a31c1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:05.422391 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9f66b9d9-44b6-43b6-8aa2-bf21861a31c1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:05.442488 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9f66b9d9-44b6-43b6-8aa2-bf21861a31c1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:05.443020 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9f66b9d9-44b6-43b6-8aa2-bf21861a31c1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:05.448761 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9f66b9d9-44b6-43b6-8aa2-bf21861a31c1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:05.449583 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9f66b9d9-44b6-43b6-8aa2-bf21861a31c1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:05.612991 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9f66b9d9-44b6-43b6-8aa2-bf21861a31c1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 22814 microversion: 2.20 time: 0.199963 Jan 28 00:53:05.613810 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 98/188] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:05 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 22814 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:05.676639 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4b71b53d-6df5-4ece-b68b-733289d6cbc3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:05.680226 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4b71b53d-6df5-4ece-b68b-733289d6cbc3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:05.694290 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4b71b53d-6df5-4ece-b68b-733289d6cbc3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:05.694884 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4b71b53d-6df5-4ece-b68b-733289d6cbc3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:05.718209 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4b71b53d-6df5-4ece-b68b-733289d6cbc3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:05.719516 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4b71b53d-6df5-4ece-b68b-733289d6cbc3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:06.149490 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4b71b53d-6df5-4ece-b68b-733289d6cbc3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:06.180019 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4b71b53d-6df5-4ece-b68b-733289d6cbc3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.494364 Jan 28 00:53:06.180830 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 91/189] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:05 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:06.194797 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-21233b6f-b875-4cd4-a991-8cf0d53d924c tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:06.195527 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-21233b6f-b875-4cd4-a991-8cf0d53d924c tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:06.213967 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-21233b6f-b875-4cd4-a991-8cf0d53d924c tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:06.220761 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-21233b6f-b875-4cd4-a991-8cf0d53d924c tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:06.221874 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-21233b6f-b875-4cd4-a991-8cf0d53d924c tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:06.223241 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-21233b6f-b875-4cd4-a991-8cf0d53d924c tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:06.630283 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-21233b6f-b875-4cd4-a991-8cf0d53d924c tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:06.639093 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-21233b6f-b875-4cd4-a991-8cf0d53d924c tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6" status: 200 len: 1318 microversion: 2.1 time: 0.450202 Jan 28 00:53:06.640564 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 99/190] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:06 2022] GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6 => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:06.645649 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4b5f18c0-3d10-4a36-84f3-d621d005389a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:06.647153 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4b5f18c0-3d10-4a36-84f3-d621d005389a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:06.664502 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4b5f18c0-3d10-4a36-84f3-d621d005389a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:06.665677 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4b5f18c0-3d10-4a36-84f3-d621d005389a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:06.668092 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4b5f18c0-3d10-4a36-84f3-d621d005389a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:06.668925 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4b5f18c0-3d10-4a36-84f3-d621d005389a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:07.205697 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1b86c601-480a-491c-ba31-bd384474e111 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:07.209918 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1b86c601-480a-491c-ba31-bd384474e111 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:07.219906 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1b86c601-480a-491c-ba31-bd384474e111 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:07.220367 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1b86c601-480a-491c-ba31-bd384474e111 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:07.221237 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1b86c601-480a-491c-ba31-bd384474e111 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:07.221692 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1b86c601-480a-491c-ba31-bd384474e111 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:07.515084 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-1b86c601-480a-491c-ba31-bd384474e111 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:07.534376 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1b86c601-480a-491c-ba31-bd384474e111 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.338294 Jan 28 00:53:07.536086 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 100/191] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:07 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:07.664698 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-bcafeee8-9589-440e-9cab-8e0535263b03 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:07.665760 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-bcafeee8-9589-440e-9cab-8e0535263b03 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:07.683094 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bcafeee8-9589-440e-9cab-8e0535263b03 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:07.683589 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bcafeee8-9589-440e-9cab-8e0535263b03 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:07.684496 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bcafeee8-9589-440e-9cab-8e0535263b03 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:07.684915 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bcafeee8-9589-440e-9cab-8e0535263b03 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:07.902914 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-bcafeee8-9589-440e-9cab-8e0535263b03 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:07.918117 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-bcafeee8-9589-440e-9cab-8e0535263b03 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6" status: 200 len: 1318 microversion: 2.1 time: 0.259852 Jan 28 00:53:07.920266 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 101/192] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:07 2022] GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:08.293570 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-57d94da4-7748-4202-86c7-76845b11e05d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'create', calling method: .version_select at 0x7fbbc26569d0>, body: {"keypair": {"name": "tempest-keypair-905234909"}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:08.334777 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-57d94da4-7748-4202-86c7-76845b11e05d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Getting quotas for project 3e774ad4314a49b4a0a8db735e0d8424. Resources: {'key_pairs'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:53:08.340375 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-57d94da4-7748-4202-86c7-76845b11e05d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Getting quotas for user 3f7380dfc9f44ee2acddd560f1968989 and project 3e774ad4314a49b4a0a8db735e0d8424. Resources: {'key_pairs'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:53:08.503103 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-57d94da4-7748-4202-86c7-76845b11e05d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Getting quotas for project 3e774ad4314a49b4a0a8db735e0d8424. Resources: {'key_pairs'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:53:08.510752 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-57d94da4-7748-4202-86c7-76845b11e05d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Getting quotas for user 3f7380dfc9f44ee2acddd560f1968989 and project 3e774ad4314a49b4a0a8db735e0d8424. Resources: {'key_pairs'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:53:08.518164 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4b5f18c0-3d10-4a36-84f3-d621d005389a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 24858 microversion: 2.20 time: 1.895188 Jan 28 00:53:08.526992 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 92/193] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:06 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 24858 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:53:08.536213 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-749f5ba4-7ac7-41b1-9c4d-4ff5e2872ac2 req-ef08b886-7d23-4c4d-b511-5e952129baf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b14e9c4-567f-45aa-942a-1acae5d9eff6", "name": "network-vif-plugged", "status": "completed", "tag": "d25cd54a-55bc-4938-b4e0-1fb9bfa8d8f0"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:08.545831 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:53:08.545831 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:53:08.567767 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-749f5ba4-7ac7-41b1-9c4d-4ff5e2872ac2 req-ef08b886-7d23-4c4d-b511-5e952129baf1 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:08.568511 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-749f5ba4-7ac7-41b1-9c4d-4ff5e2872ac2 req-ef08b886-7d23-4c4d-b511-5e952129baf1 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:08.572003 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-57d94da4-7748-4202-86c7-76845b11e05d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.648812 Jan 28 00:53:08.573018 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 102/194] 10.222.0.25 () {60 vars in 1157 bytes} [Fri Jan 28 00:53:07 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:08.589643 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-c5de8808-f677-4abf-a1b1-5a619f731151 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:08.592568 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-c5de8808-f677-4abf-a1b1-5a619f731151 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:08.610282 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-749f5ba4-7ac7-41b1-9c4d-4ff5e2872ac2 req-ef08b886-7d23-4c4d-b511-5e952129baf1 service nova] Creating event network-vif-plugged:d25cd54a-55bc-4938-b4e0-1fb9bfa8d8f0 for instance 4b14e9c4-567f-45aa-942a-1acae5d9eff6 on hv-cinder-80952 Jan 28 00:53:08.611566 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c5de8808-f677-4abf-a1b1-5a619f731151 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:08.613442 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c5de8808-f677-4abf-a1b1-5a619f731151 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:08.618001 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c5de8808-f677-4abf-a1b1-5a619f731151 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:08.621894 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c5de8808-f677-4abf-a1b1-5a619f731151 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:08.654066 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-749f5ba4-7ac7-41b1-9c4d-4ff5e2872ac2 req-ef08b886-7d23-4c4d-b511-5e952129baf1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119410 Jan 28 00:53:08.665847 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 93/195] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:53:08.889790 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c5de8808-f677-4abf-a1b1-5a619f731151 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:08.903879 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-c5de8808-f677-4abf-a1b1-5a619f731151 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.329535 Jan 28 00:53:08.905128 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 103/196] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:08 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:08.956059 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-007c9841-4d3e-490e-8d8f-e14f463c5c7b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:08.957169 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-007c9841-4d3e-490e-8d8f-e14f463c5c7b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:08.977992 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-007c9841-4d3e-490e-8d8f-e14f463c5c7b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:08.979748 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-007c9841-4d3e-490e-8d8f-e14f463c5c7b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:08.981846 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-007c9841-4d3e-490e-8d8f-e14f463c5c7b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:08.982582 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-007c9841-4d3e-490e-8d8f-e14f463c5c7b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:09.364047 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-007c9841-4d3e-490e-8d8f-e14f463c5c7b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:09.380480 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-007c9841-4d3e-490e-8d8f-e14f463c5c7b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6" status: 200 len: 1318 microversion: 2.1 time: 0.429314 Jan 28 00:53:09.382395 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 94/197] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:08 2022] GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:09.538535 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-a68db528-a928-4743-b4dc-10532f87518e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:09.540801 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-a68db528-a928-4743-b4dc-10532f87518e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:09.551116 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a68db528-a928-4743-b4dc-10532f87518e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:09.552442 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a68db528-a928-4743-b4dc-10532f87518e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:09.554161 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a68db528-a928-4743-b4dc-10532f87518e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:09.555242 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a68db528-a928-4743-b4dc-10532f87518e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:09.870742 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-a68db528-a928-4743-b4dc-10532f87518e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 26021 microversion: 2.20 time: 0.340118 Jan 28 00:53:09.876307 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 104/198] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:09 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 26021 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:09.942346 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a31e1ade-7720-425d-966f-fc56e473d9b5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:09.950968 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a31e1ade-7720-425d-966f-fc56e473d9b5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:09.967396 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a31e1ade-7720-425d-966f-fc56e473d9b5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:09.968246 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a31e1ade-7720-425d-966f-fc56e473d9b5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:09.969826 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a31e1ade-7720-425d-966f-fc56e473d9b5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:09.988736 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a31e1ade-7720-425d-966f-fc56e473d9b5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:10.341315 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a31e1ade-7720-425d-966f-fc56e473d9b5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:10.367429 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a31e1ade-7720-425d-966f-fc56e473d9b5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.430773 Jan 28 00:53:10.371521 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 95/199] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:09 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:10.400696 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-742d6076-9ab8-491c-89ee-5137afa1dce6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:10.402009 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-742d6076-9ab8-491c-89ee-5137afa1dce6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:10.414760 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-742d6076-9ab8-491c-89ee-5137afa1dce6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:10.415197 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-742d6076-9ab8-491c-89ee-5137afa1dce6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:10.419817 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-742d6076-9ab8-491c-89ee-5137afa1dce6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:10.422802 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-742d6076-9ab8-491c-89ee-5137afa1dce6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:10.889927 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ff8edeb2-6f44-433a-b0b9-f5b2ff100c92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:10.898048 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ff8edeb2-6f44-433a-b0b9-f5b2ff100c92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:10.929338 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ff8edeb2-6f44-433a-b0b9-f5b2ff100c92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:10.943541 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ff8edeb2-6f44-433a-b0b9-f5b2ff100c92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:10.943541 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ff8edeb2-6f44-433a-b0b9-f5b2ff100c92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:10.943541 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ff8edeb2-6f44-433a-b0b9-f5b2ff100c92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:11.073173 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-742d6076-9ab8-491c-89ee-5137afa1dce6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:11.110043 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-742d6076-9ab8-491c-89ee-5137afa1dce6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6" status: 200 len: 1318 microversion: 2.1 time: 0.713304 Jan 28 00:53:11.118687 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ff8edeb2-6f44-433a-b0b9-f5b2ff100c92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 26775 microversion: 2.20 time: 0.237104 Jan 28 00:53:11.119983 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 96/200] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:10 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 26775 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:11.123744 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 105/201] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:10 2022] GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6 => generated 1318 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:11.402701 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a14f38fc-a719-44b0-bab9-53d665231ab9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:11.403958 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a14f38fc-a719-44b0-bab9-53d665231ab9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:11.416101 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a14f38fc-a719-44b0-bab9-53d665231ab9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:11.417038 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a14f38fc-a719-44b0-bab9-53d665231ab9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:11.418411 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a14f38fc-a719-44b0-bab9-53d665231ab9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:11.419169 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a14f38fc-a719-44b0-bab9-53d665231ab9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:11.867474 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a14f38fc-a719-44b0-bab9-53d665231ab9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:11.881450 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a14f38fc-a719-44b0-bab9-53d665231ab9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.486081 Jan 28 00:53:11.905823 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 97/202] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:11 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:12.148847 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9dd08f35-833a-4113-9878-4c365ca28655 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:12.150592 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9dd08f35-833a-4113-9878-4c365ca28655 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:12.165042 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a2723c69-fb23-4dee-aaba-36a3069f9e27 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:12.166846 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a2723c69-fb23-4dee-aaba-36a3069f9e27 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:12.179499 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9dd08f35-833a-4113-9878-4c365ca28655 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:12.185760 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a2723c69-fb23-4dee-aaba-36a3069f9e27 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:12.186391 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a2723c69-fb23-4dee-aaba-36a3069f9e27 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:12.188972 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9dd08f35-833a-4113-9878-4c365ca28655 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:12.191223 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9dd08f35-833a-4113-9878-4c365ca28655 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:12.192325 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9dd08f35-833a-4113-9878-4c365ca28655 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:12.199712 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a2723c69-fb23-4dee-aaba-36a3069f9e27 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:12.200869 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a2723c69-fb23-4dee-aaba-36a3069f9e27 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:12.388899 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9dd08f35-833a-4113-9878-4c365ca28655 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 27446 microversion: 2.20 time: 0.261036 Jan 28 00:53:12.392893 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 106/203] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:12 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 27446 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:12.628198 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a2723c69-fb23-4dee-aaba-36a3069f9e27 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:12.641681 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a2723c69-fb23-4dee-aaba-36a3069f9e27 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6" status: 200 len: 1507 microversion: 2.1 time: 0.498791 Jan 28 00:53:12.645720 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 98/204] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:12 2022] GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6 => generated 1507 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:12.773884 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-c5a4fd7d-555d-4bf4-a931-8391818f08b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1304895247", "imageRef": "7fe09c59-2ff9-4639-b39d-9a474e83ad91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6354805f-672a-4641-babe-b974486e9fdf"}], "security_groups": [{"name": "tempest-securitygroup--1400697574"}], "key_name": "tempest-keypair-905234909", "user_data": "}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:12.920378 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d584f76e-0279-4a6c-a807-720406decb28 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:12.925142 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d584f76e-0279-4a6c-a807-720406decb28 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:12.946632 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d584f76e-0279-4a6c-a807-720406decb28 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:12.947633 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d584f76e-0279-4a6c-a807-720406decb28 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:12.954436 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d584f76e-0279-4a6c-a807-720406decb28 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:12.957292 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d584f76e-0279-4a6c-a807-720406decb28 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:12.998939 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.network.neutron [None req-c5a4fd7d-555d-4bf4-a931-8391818f08b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] validate_networks() for [('6354805f-672a-4641-babe-b974486e9fdf', None, None, None, None, None)] {{(pid=127862) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:53:13.329761 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d584f76e-0279-4a6c-a807-720406decb28 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:13.337946 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d584f76e-0279-4a6c-a807-720406decb28 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.426680 Jan 28 00:53:13.338560 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 99/205] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:12 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:13.402093 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-393f048f-b4c3-43de-9050-8f1426214310 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:13.402920 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-393f048f-b4c3-43de-9050-8f1426214310 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:13.412791 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-393f048f-b4c3-43de-9050-8f1426214310 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:13.413322 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-393f048f-b4c3-43de-9050-8f1426214310 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:13.415583 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-393f048f-b4c3-43de-9050-8f1426214310 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:13.418530 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-393f048f-b4c3-43de-9050-8f1426214310 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:13.651578 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-393f048f-b4c3-43de-9050-8f1426214310 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 27814 microversion: 2.20 time: 0.253460 Jan 28 00:53:13.653242 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 100/206] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:13 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 27814 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:13.895060 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-c5a4fd7d-555d-4bf4-a931-8391818f08b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Flavor limits 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:53:13.896390 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-c5a4fd7d-555d-4bf4-a931-8391818f08b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Image limits 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:53:13.897116 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-c5a4fd7d-555d-4bf4-a931-8391818f08b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Flavor pref 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:53:13.897724 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-c5a4fd7d-555d-4bf4-a931-8391818f08b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Image pref 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:53:13.898330 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-c5a4fd7d-555d-4bf4-a931-8391818f08b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:53:13.911764 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c5a4fd7d-555d-4bf4-a931-8391818f08b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:13.912129 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c5a4fd7d-555d-4bf4-a931-8391818f08b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:13.913293 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c5a4fd7d-555d-4bf4-a931-8391818f08b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:13.913743 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c5a4fd7d-555d-4bf4-a931-8391818f08b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:13.958758 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-c5a4fd7d-555d-4bf4-a931-8391818f08b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Getting quotas for project 3e774ad4314a49b4a0a8db735e0d8424. Resources: {'instances', 'cores', 'ram'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:53:13.976161 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-c5a4fd7d-555d-4bf4-a931-8391818f08b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Getting quotas for user 3f7380dfc9f44ee2acddd560f1968989 and project 3e774ad4314a49b4a0a8db735e0d8424. Resources: {'instances', 'cores', 'ram'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:53:13.994736 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-c5a4fd7d-555d-4bf4-a931-8391818f08b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Going to run 1 instances... {{(pid=127862) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:53:13.998814 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-c5a4fd7d-555d-4bf4-a931-8391818f08b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fe09c59-2ff9-4639-b39d-9a474e83ad91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:53:14.107349 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-c5a4fd7d-555d-4bf4-a931-8391818f08b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.346415 Jan 28 00:53:14.119692 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 107/207] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 00:53:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 00:53:14.136125 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d3877ab4-6c76-42c1-8354-c60218f73604 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:14.137979 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d3877ab4-6c76-42c1-8354-c60218f73604 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:14.216840 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d3877ab4-6c76-42c1-8354-c60218f73604 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:14.232791 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d3877ab4-6c76-42c1-8354-c60218f73604 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1237 microversion: 2.1 time: 0.106116 Jan 28 00:53:14.233830 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 101/208] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:14 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1237 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:14.364724 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9c6db3d1-362d-47b8-b6b9-7b4d9ff6f574 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:14.365225 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9c6db3d1-362d-47b8-b6b9-7b4d9ff6f574 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:14.372240 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9c6db3d1-362d-47b8-b6b9-7b4d9ff6f574 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:14.372969 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9c6db3d1-362d-47b8-b6b9-7b4d9ff6f574 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:14.374137 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9c6db3d1-362d-47b8-b6b9-7b4d9ff6f574 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:14.374795 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9c6db3d1-362d-47b8-b6b9-7b4d9ff6f574 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:14.631055 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9c6db3d1-362d-47b8-b6b9-7b4d9ff6f574 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:14.646798 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9c6db3d1-362d-47b8-b6b9-7b4d9ff6f574 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.285353 Jan 28 00:53:14.658696 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 108/209] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:14 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:14.665546 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d50927cc-0743-47b7-9a57-e649eb2c1a52 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:14.666495 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d50927cc-0743-47b7-9a57-e649eb2c1a52 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:14.680762 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d50927cc-0743-47b7-9a57-e649eb2c1a52 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:14.681194 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d50927cc-0743-47b7-9a57-e649eb2c1a52 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:14.686198 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d50927cc-0743-47b7-9a57-e649eb2c1a52 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:14.687209 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d50927cc-0743-47b7-9a57-e649eb2c1a52 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:15.258677 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-02833a61-b7a5-4710-80c9-bd9b3ff9f825 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:15.259350 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-02833a61-b7a5-4710-80c9-bd9b3ff9f825 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:15.267737 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-02833a61-b7a5-4710-80c9-bd9b3ff9f825 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:15.269074 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-02833a61-b7a5-4710-80c9-bd9b3ff9f825 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:15.269916 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-02833a61-b7a5-4710-80c9-bd9b3ff9f825 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:15.270389 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-02833a61-b7a5-4710-80c9-bd9b3ff9f825 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:15.361331 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-02833a61-b7a5-4710-80c9-bd9b3ff9f825 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:15.369900 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-02833a61-b7a5-4710-80c9-bd9b3ff9f825 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1241 microversion: 2.1 time: 0.116604 Jan 28 00:53:15.370981 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 109/210] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:15 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1241 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:15.666368 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f0785ada-1448-4673-9502-75b839788488 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:15.666998 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f0785ada-1448-4673-9502-75b839788488 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:15.689450 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f0785ada-1448-4673-9502-75b839788488 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:15.690067 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f0785ada-1448-4673-9502-75b839788488 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:15.691901 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f0785ada-1448-4673-9502-75b839788488 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:15.692557 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f0785ada-1448-4673-9502-75b839788488 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:15.978479 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f0785ada-1448-4673-9502-75b839788488 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:15.989875 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f0785ada-1448-4673-9502-75b839788488 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.327115 Jan 28 00:53:15.990942 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 110/211] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:15 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:16.387848 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-087bb372-2df5-4607-a6e5-b1180e49e8b7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:16.389202 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-087bb372-2df5-4607-a6e5-b1180e49e8b7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:16.397175 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-087bb372-2df5-4607-a6e5-b1180e49e8b7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:16.397917 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-087bb372-2df5-4607-a6e5-b1180e49e8b7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:16.398958 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-087bb372-2df5-4607-a6e5-b1180e49e8b7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:16.399610 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-087bb372-2df5-4607-a6e5-b1180e49e8b7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:16.502084 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-087bb372-2df5-4607-a6e5-b1180e49e8b7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:16.509557 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-087bb372-2df5-4607-a6e5-b1180e49e8b7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1241 microversion: 2.1 time: 0.125565 Jan 28 00:53:16.510148 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 111/212] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:16 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1241 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:17.008945 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ae841936-8e6a-4278-8499-7c74491a8c4d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:17.009887 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ae841936-8e6a-4278-8499-7c74491a8c4d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:17.017164 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ae841936-8e6a-4278-8499-7c74491a8c4d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:17.017776 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ae841936-8e6a-4278-8499-7c74491a8c4d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:17.018817 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ae841936-8e6a-4278-8499-7c74491a8c4d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:17.019563 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ae841936-8e6a-4278-8499-7c74491a8c4d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:17.194007 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ae841936-8e6a-4278-8499-7c74491a8c4d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:17.206292 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ae841936-8e6a-4278-8499-7c74491a8c4d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.201463 Jan 28 00:53:17.207488 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 112/213] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:17 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:17.526865 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-456ce8ed-053d-44dd-8c6c-8433f6788eb3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:17.528257 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-456ce8ed-053d-44dd-8c6c-8433f6788eb3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:17.546443 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-456ce8ed-053d-44dd-8c6c-8433f6788eb3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:17.547466 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-456ce8ed-053d-44dd-8c6c-8433f6788eb3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:17.548784 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-456ce8ed-053d-44dd-8c6c-8433f6788eb3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:17.548909 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d50927cc-0743-47b7-9a57-e649eb2c1a52 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 28184 microversion: 2.20 time: 2.886459 Jan 28 00:53:17.550183 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 102/214] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:14 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 28184 bytes in 2890 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:17.555750 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-456ce8ed-053d-44dd-8c6c-8433f6788eb3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:17.640984 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-456ce8ed-053d-44dd-8c6c-8433f6788eb3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:17.651805 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-456ce8ed-053d-44dd-8c6c-8433f6788eb3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1241 microversion: 2.1 time: 0.129584 Jan 28 00:53:17.652528 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 113/215] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:17 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1241 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:18.226169 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3fad64ae-b993-4515-9dce-58d41b1d29d5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:18.226878 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-3fad64ae-b993-4515-9dce-58d41b1d29d5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:18.238248 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3fad64ae-b993-4515-9dce-58d41b1d29d5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:18.238248 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3fad64ae-b993-4515-9dce-58d41b1d29d5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:18.244301 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3fad64ae-b993-4515-9dce-58d41b1d29d5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:18.244301 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3fad64ae-b993-4515-9dce-58d41b1d29d5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:18.421592 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-3fad64ae-b993-4515-9dce-58d41b1d29d5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:18.434597 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3fad64ae-b993-4515-9dce-58d41b1d29d5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.214178 Jan 28 00:53:18.451835 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 103/216] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:18 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:18.564149 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-15a7a657-1829-434f-b911-6911f316c0f0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:18.564149 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-15a7a657-1829-434f-b911-6911f316c0f0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:18.573988 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-15a7a657-1829-434f-b911-6911f316c0f0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:18.575383 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-15a7a657-1829-434f-b911-6911f316c0f0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:18.577306 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-15a7a657-1829-434f-b911-6911f316c0f0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:18.578408 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-15a7a657-1829-434f-b911-6911f316c0f0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:18.670854 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2114291b-1202-41a3-ab90-f602c2e51a2d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:18.672274 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2114291b-1202-41a3-ab90-f602c2e51a2d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:18.681764 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2114291b-1202-41a3-ab90-f602c2e51a2d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:18.682680 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2114291b-1202-41a3-ab90-f602c2e51a2d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:18.686155 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2114291b-1202-41a3-ab90-f602c2e51a2d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:18.686155 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2114291b-1202-41a3-ab90-f602c2e51a2d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:18.723325 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-15a7a657-1829-434f-b911-6911f316c0f0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 28184 microversion: 2.20 time: 0.164373 Jan 28 00:53:18.724413 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 114/217] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:18 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 28184 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:18.794648 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-2114291b-1202-41a3-ab90-f602c2e51a2d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:18.803906 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2114291b-1202-41a3-ab90-f602c2e51a2d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1295 microversion: 2.1 time: 0.137951 Jan 28 00:53:18.804408 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 104/218] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:18 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1295 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:19.471071 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f2b0e6a8-f7de-412f-9f72-8d91ea58191c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:19.472707 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f2b0e6a8-f7de-412f-9f72-8d91ea58191c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:19.481179 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f2b0e6a8-f7de-412f-9f72-8d91ea58191c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:19.481989 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f2b0e6a8-f7de-412f-9f72-8d91ea58191c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:19.484000 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f2b0e6a8-f7de-412f-9f72-8d91ea58191c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:19.484788 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f2b0e6a8-f7de-412f-9f72-8d91ea58191c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:19.736775 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5829718c-f2d0-42a5-ac27-eb8aae2484da tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:19.740245 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5829718c-f2d0-42a5-ac27-eb8aae2484da tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:19.757800 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5829718c-f2d0-42a5-ac27-eb8aae2484da tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:19.759570 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5829718c-f2d0-42a5-ac27-eb8aae2484da tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:19.760568 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5829718c-f2d0-42a5-ac27-eb8aae2484da tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:19.762991 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5829718c-f2d0-42a5-ac27-eb8aae2484da tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:19.920029 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f2b0e6a8-f7de-412f-9f72-8d91ea58191c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:19.949301 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f2b0e6a8-f7de-412f-9f72-8d91ea58191c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.471158 Jan 28 00:53:19.949998 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 115/219] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:19 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:19.962711 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-bf261dd3-9f3b-4ded-8419-1d7a3c3c265e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:19.962711 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-bf261dd3-9f3b-4ded-8419-1d7a3c3c265e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:19.971052 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bf261dd3-9f3b-4ded-8419-1d7a3c3c265e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:19.972591 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bf261dd3-9f3b-4ded-8419-1d7a3c3c265e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:19.973529 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bf261dd3-9f3b-4ded-8419-1d7a3c3c265e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:19.973700 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bf261dd3-9f3b-4ded-8419-1d7a3c3c265e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:19.982340 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5829718c-f2d0-42a5-ac27-eb8aae2484da tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 28184 microversion: 2.20 time: 0.249455 Jan 28 00:53:19.990342 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 105/220] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:19 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 28184 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:53:20.508126 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-bf261dd3-9f3b-4ded-8419-1d7a3c3c265e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:20.518362 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-bf261dd3-9f3b-4ded-8419-1d7a3c3c265e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1363 microversion: 2.1 time: 0.567116 Jan 28 00:53:20.519182 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 116/221] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:19 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1363 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:20.972667 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-6b144155-c0dd-4273-a908-60efd8df9540 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:20.973704 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-6b144155-c0dd-4273-a908-60efd8df9540 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:20.984810 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6b144155-c0dd-4273-a908-60efd8df9540 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:20.985966 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6b144155-c0dd-4273-a908-60efd8df9540 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:20.988887 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6b144155-c0dd-4273-a908-60efd8df9540 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:20.990305 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6b144155-c0dd-4273-a908-60efd8df9540 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:21.030528 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d4d08336-f898-47f7-9fe3-8b44d903e401 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:21.036724 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d4d08336-f898-47f7-9fe3-8b44d903e401 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:21.075958 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d4d08336-f898-47f7-9fe3-8b44d903e401 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:21.099758 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d4d08336-f898-47f7-9fe3-8b44d903e401 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:21.109214 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d4d08336-f898-47f7-9fe3-8b44d903e401 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:21.113069 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d4d08336-f898-47f7-9fe3-8b44d903e401 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:21.242687 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d4d08336-f898-47f7-9fe3-8b44d903e401 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 28475 microversion: 2.20 time: 0.247515 Jan 28 00:53:21.243652 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 117/222] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:20 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 28475 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:21.250208 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-d39c0bd9-5e1e-4bcc-82a3-13ed3528f3cd req-a30678b6-b2f4-4148-be14-939c125c9edc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4dbbfd4-609c-4041-b0b5-b939f759eecd", "tag": "ec21ff23-6b4d-4c5a-b463-a671e6aea7ed"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:21.251838 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:53:21.251838 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:53:21.271622 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-d39c0bd9-5e1e-4bcc-82a3-13ed3528f3cd req-a30678b6-b2f4-4148-be14-939c125c9edc service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:21.272407 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-d39c0bd9-5e1e-4bcc-82a3-13ed3528f3cd req-a30678b6-b2f4-4148-be14-939c125c9edc service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:21.290714 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-d39c0bd9-5e1e-4bcc-82a3-13ed3528f3cd req-a30678b6-b2f4-4148-be14-939c125c9edc service nova] Creating event network-changed:ec21ff23-6b4d-4c5a-b463-a671e6aea7ed for instance a4dbbfd4-609c-4041-b0b5-b939f759eecd on hv-cinder-80952 Jan 28 00:53:21.297203 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-d39c0bd9-5e1e-4bcc-82a3-13ed3528f3cd req-a30678b6-b2f4-4148-be14-939c125c9edc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051857 Jan 28 00:53:21.298528 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 118/223] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:53:21.539381 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1ec849c7-dad3-41e4-8cdd-266f087789e4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:21.541101 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1ec849c7-dad3-41e4-8cdd-266f087789e4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:21.552892 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1ec849c7-dad3-41e4-8cdd-266f087789e4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:21.553876 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1ec849c7-dad3-41e4-8cdd-266f087789e4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:21.555574 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1ec849c7-dad3-41e4-8cdd-266f087789e4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:21.556271 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1ec849c7-dad3-41e4-8cdd-266f087789e4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:21.915207 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-6b144155-c0dd-4273-a908-60efd8df9540 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:21.929228 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-6b144155-c0dd-4273-a908-60efd8df9540 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.960413 Jan 28 00:53:21.930210 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 106/224] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:20 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:22.017674 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-1ec849c7-dad3-41e4-8cdd-266f087789e4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:22.032662 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1ec849c7-dad3-41e4-8cdd-266f087789e4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1363 microversion: 2.1 time: 0.498972 Jan 28 00:53:22.036273 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 119/225] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:21 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1363 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:22.257574 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7df37b94-cee7-45a6-b006-deed279df0dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:22.258535 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7df37b94-cee7-45a6-b006-deed279df0dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:22.267396 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7df37b94-cee7-45a6-b006-deed279df0dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:22.268711 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7df37b94-cee7-45a6-b006-deed279df0dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:22.271365 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7df37b94-cee7-45a6-b006-deed279df0dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:22.272514 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7df37b94-cee7-45a6-b006-deed279df0dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:22.544948 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7df37b94-cee7-45a6-b006-deed279df0dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 28616 microversion: 2.20 time: 0.291769 Jan 28 00:53:22.546028 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 107/226] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:22 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 28616 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:53:22.953292 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-05acf7da-8df0-484d-9cb4-734a587cc2a6 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:22.954003 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-05acf7da-8df0-484d-9cb4-734a587cc2a6 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:22.964888 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-05acf7da-8df0-484d-9cb4-734a587cc2a6 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:22.965750 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-05acf7da-8df0-484d-9cb4-734a587cc2a6 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:22.967694 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-05acf7da-8df0-484d-9cb4-734a587cc2a6 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:22.969289 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-05acf7da-8df0-484d-9cb4-734a587cc2a6 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:23.064718 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4e507dcf-e260-4711-8aa4-ff8db7c07e86 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:23.064718 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4e507dcf-e260-4711-8aa4-ff8db7c07e86 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:23.095808 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4e507dcf-e260-4711-8aa4-ff8db7c07e86 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:23.098883 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4e507dcf-e260-4711-8aa4-ff8db7c07e86 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:23.115640 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4e507dcf-e260-4711-8aa4-ff8db7c07e86 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:23.116967 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4e507dcf-e260-4711-8aa4-ff8db7c07e86 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:23.438911 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-05acf7da-8df0-484d-9cb4-734a587cc2a6 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:23.490267 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-05acf7da-8df0-484d-9cb4-734a587cc2a6 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.539907 Jan 28 00:53:23.509435 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 120/227] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:22 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:23.570199 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-45fae074-528b-4116-8377-064427fb028d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:23.580129 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-45fae074-528b-4116-8377-064427fb028d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:23.617063 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-45fae074-528b-4116-8377-064427fb028d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:23.619729 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-45fae074-528b-4116-8377-064427fb028d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:23.622332 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-45fae074-528b-4116-8377-064427fb028d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:23.623458 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-45fae074-528b-4116-8377-064427fb028d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:23.679425 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4e507dcf-e260-4711-8aa4-ff8db7c07e86 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:23.699470 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4e507dcf-e260-4711-8aa4-ff8db7c07e86 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1363 microversion: 2.1 time: 0.648003 Jan 28 00:53:23.700693 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 108/228] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:23 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1363 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:23.807950 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-45fae074-528b-4116-8377-064427fb028d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 28641 microversion: 2.20 time: 0.248734 Jan 28 00:53:23.817031 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 121/229] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:23 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 28641 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:24.524144 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-46b15c36-419a-4ca5-984a-e4c1b9c4d429 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:24.526391 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-46b15c36-419a-4ca5-984a-e4c1b9c4d429 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:24.541097 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-46b15c36-419a-4ca5-984a-e4c1b9c4d429 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:24.541843 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-46b15c36-419a-4ca5-984a-e4c1b9c4d429 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:24.543200 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-46b15c36-419a-4ca5-984a-e4c1b9c4d429 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:24.544031 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-46b15c36-419a-4ca5-984a-e4c1b9c4d429 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:24.746922 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-13d4ead9-33c0-451c-9a60-076f31fc53df tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:24.748384 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-13d4ead9-33c0-451c-9a60-076f31fc53df tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:24.770499 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-13d4ead9-33c0-451c-9a60-076f31fc53df tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:24.771340 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-13d4ead9-33c0-451c-9a60-076f31fc53df tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:24.773076 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-13d4ead9-33c0-451c-9a60-076f31fc53df tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:24.773861 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-13d4ead9-33c0-451c-9a60-076f31fc53df tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:25.014041 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-46b15c36-419a-4ca5-984a-e4c1b9c4d429 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:25.039451 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-46b15c36-419a-4ca5-984a-e4c1b9c4d429 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.522816 Jan 28 00:53:25.040607 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 109/230] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:24 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:25.059627 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-6cad7657-e9aa-487a-95c8-5e1822664908 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:25.061776 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-6cad7657-e9aa-487a-95c8-5e1822664908 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:25.073680 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6cad7657-e9aa-487a-95c8-5e1822664908 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:25.074541 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6cad7657-e9aa-487a-95c8-5e1822664908 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:25.076101 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6cad7657-e9aa-487a-95c8-5e1822664908 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:25.076922 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6cad7657-e9aa-487a-95c8-5e1822664908 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:25.211250 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-13d4ead9-33c0-451c-9a60-076f31fc53df tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:25.219200 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-13d4ead9-33c0-451c-9a60-076f31fc53df tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1363 microversion: 2.1 time: 0.489826 Jan 28 00:53:25.219830 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 122/231] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:24 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1363 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:25.238362 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-6cad7657-e9aa-487a-95c8-5e1822664908 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 28641 microversion: 2.20 time: 0.194730 Jan 28 00:53:25.240149 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 110/232] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:25 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 28641 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:26.081537 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-be26aab0-3d59-4c53-8cbc-d899370f1a6c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:26.084080 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-be26aab0-3d59-4c53-8cbc-d899370f1a6c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:26.095883 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-be26aab0-3d59-4c53-8cbc-d899370f1a6c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:26.097181 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-be26aab0-3d59-4c53-8cbc-d899370f1a6c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:26.099000 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-be26aab0-3d59-4c53-8cbc-d899370f1a6c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:26.100046 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-be26aab0-3d59-4c53-8cbc-d899370f1a6c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:26.251233 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-87a55534-a6ba-4eef-b524-4c49de17dcfc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:26.254381 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-87a55534-a6ba-4eef-b524-4c49de17dcfc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:26.281561 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-87a55534-a6ba-4eef-b524-4c49de17dcfc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:26.282380 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-87a55534-a6ba-4eef-b524-4c49de17dcfc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:26.283892 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-87a55534-a6ba-4eef-b524-4c49de17dcfc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:26.284891 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-87a55534-a6ba-4eef-b524-4c49de17dcfc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:26.555946 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-be26aab0-3d59-4c53-8cbc-d899370f1a6c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:26.572240 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-be26aab0-3d59-4c53-8cbc-d899370f1a6c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.500098 Jan 28 00:53:26.576664 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 123/233] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:26 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:26.622542 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-6579e0a9-4bfa-4d55-9dd6-dd45b589e587 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:26.624872 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-6579e0a9-4bfa-4d55-9dd6-dd45b589e587 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:26.639158 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6579e0a9-4bfa-4d55-9dd6-dd45b589e587 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:26.640804 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6579e0a9-4bfa-4d55-9dd6-dd45b589e587 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:26.642996 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6579e0a9-4bfa-4d55-9dd6-dd45b589e587 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:26.644171 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6579e0a9-4bfa-4d55-9dd6-dd45b589e587 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:26.708782 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-87a55534-a6ba-4eef-b524-4c49de17dcfc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:26.733138 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-87a55534-a6ba-4eef-b524-4c49de17dcfc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1363 microversion: 2.1 time: 0.491797 Jan 28 00:53:26.735714 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 111/234] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:26 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1363 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:26.796950 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-6579e0a9-4bfa-4d55-9dd6-dd45b589e587 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 28641 microversion: 2.20 time: 0.199955 Jan 28 00:53:26.804563 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 124/235] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:26 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 28641 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:27.609611 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-690ad904-0e47-4ef1-a40f-06a6e989c07b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:27.611580 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-690ad904-0e47-4ef1-a40f-06a6e989c07b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:27.628163 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-690ad904-0e47-4ef1-a40f-06a6e989c07b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:27.629763 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-690ad904-0e47-4ef1-a40f-06a6e989c07b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:27.631688 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-690ad904-0e47-4ef1-a40f-06a6e989c07b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:27.632734 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-690ad904-0e47-4ef1-a40f-06a6e989c07b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:27.764937 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3bab222a-70cf-4b5a-a326-7b8cd4df8f3d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:27.766107 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3bab222a-70cf-4b5a-a326-7b8cd4df8f3d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:27.804916 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3bab222a-70cf-4b5a-a326-7b8cd4df8f3d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:27.805719 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3bab222a-70cf-4b5a-a326-7b8cd4df8f3d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:27.808936 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3bab222a-70cf-4b5a-a326-7b8cd4df8f3d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:27.809787 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3bab222a-70cf-4b5a-a326-7b8cd4df8f3d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:27.982626 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-690ad904-0e47-4ef1-a40f-06a6e989c07b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:27.998991 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-690ad904-0e47-4ef1-a40f-06a6e989c07b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.397756 Jan 28 00:53:28.020071 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 112/236] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:27 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:28.040214 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ee269297-df4a-40fa-a18b-c266c6118e43 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:28.042067 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ee269297-df4a-40fa-a18b-c266c6118e43 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:28.055498 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ee269297-df4a-40fa-a18b-c266c6118e43 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:28.056608 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ee269297-df4a-40fa-a18b-c266c6118e43 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:28.058155 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ee269297-df4a-40fa-a18b-c266c6118e43 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:28.059049 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ee269297-df4a-40fa-a18b-c266c6118e43 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:28.214229 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3bab222a-70cf-4b5a-a326-7b8cd4df8f3d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:28.219479 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ee269297-df4a-40fa-a18b-c266c6118e43 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 28641 microversion: 2.20 time: 0.196548 Jan 28 00:53:28.221565 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 113/237] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:28 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 28641 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:28.229072 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-27a1fa44-2533-4ed0-bf18-eed87ae3eb35 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1035296950", "imageRef": "7fe09c59-2ff9-4639-b39d-9a474e83ad91", "flavorRef": "452", "networks": [{"uuid": "02897698-e859-4014-9247-4fc6e696d897"}]}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:28.229612 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3bab222a-70cf-4b5a-a326-7b8cd4df8f3d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1363 microversion: 2.1 time: 0.472199 Jan 28 00:53:28.231207 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 125/238] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:27 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1363 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:28.322490 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.network.neutron [None req-27a1fa44-2533-4ed0-bf18-eed87ae3eb35 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] validate_networks() for [('02897698-e859-4014-9247-4fc6e696d897', None, None, None, None, None)] {{(pid=127863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:53:29.027253 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-27a1fa44-2533-4ed0-bf18-eed87ae3eb35 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Flavor limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:53:29.028798 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-27a1fa44-2533-4ed0-bf18-eed87ae3eb35 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Image limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:53:29.029893 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-27a1fa44-2533-4ed0-bf18-eed87ae3eb35 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Flavor pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:53:29.036500 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-27a1fa44-2533-4ed0-bf18-eed87ae3eb35 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Image pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:53:29.038183 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-27a1fa44-2533-4ed0-bf18-eed87ae3eb35 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:53:29.043124 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f31b2dd8-94e6-407d-bba2-110b4eed7ffc tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:29.044430 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f31b2dd8-94e6-407d-bba2-110b4eed7ffc tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:29.064169 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-27a1fa44-2533-4ed0-bf18-eed87ae3eb35 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:29.065657 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-27a1fa44-2533-4ed0-bf18-eed87ae3eb35 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:29.068159 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-27a1fa44-2533-4ed0-bf18-eed87ae3eb35 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:29.069826 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-27a1fa44-2533-4ed0-bf18-eed87ae3eb35 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:29.071751 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f31b2dd8-94e6-407d-bba2-110b4eed7ffc tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:29.072514 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f31b2dd8-94e6-407d-bba2-110b4eed7ffc tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:29.073925 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f31b2dd8-94e6-407d-bba2-110b4eed7ffc tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:29.074707 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f31b2dd8-94e6-407d-bba2-110b4eed7ffc tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:29.103584 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-27a1fa44-2533-4ed0-bf18-eed87ae3eb35 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Getting quotas for project 731aa66b74a3493ca730bcd22915d385. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:53:29.109142 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-27a1fa44-2533-4ed0-bf18-eed87ae3eb35 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Getting quotas for user 44a854f3323e4970be40d712bda617c7 and project 731aa66b74a3493ca730bcd22915d385. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:53:29.130737 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-27a1fa44-2533-4ed0-bf18-eed87ae3eb35 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Going to run 1 instances... {{(pid=127863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:53:29.134178 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-27a1fa44-2533-4ed0-bf18-eed87ae3eb35 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fe09c59-2ff9-4639-b39d-9a474e83ad91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:53:29.238586 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-27a1fa44-2533-4ed0-bf18-eed87ae3eb35 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.014605 Jan 28 00:53:29.240457 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 114/239] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 00:53:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 00:53:29.250745 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d457138d-8489-4f39-bebd-408afdab86ac tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:29.253887 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d457138d-8489-4f39-bebd-408afdab86ac tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:29.266436 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d457138d-8489-4f39-bebd-408afdab86ac tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:29.267454 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d457138d-8489-4f39-bebd-408afdab86ac tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:29.270344 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d457138d-8489-4f39-bebd-408afdab86ac tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:29.271262 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d457138d-8489-4f39-bebd-408afdab86ac tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:29.397832 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f31b2dd8-94e6-407d-bba2-110b4eed7ffc tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:29.415098 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f31b2dd8-94e6-407d-bba2-110b4eed7ffc tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.378301 Jan 28 00:53:29.430073 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 126/240] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:29 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:29.439429 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d6304aa2-c4b2-4efb-a3a5-8ab137cc7c0b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:29.440879 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d6304aa2-c4b2-4efb-a3a5-8ab137cc7c0b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:29.457705 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d457138d-8489-4f39-bebd-408afdab86ac tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 28777 microversion: 2.20 time: 0.214614 Jan 28 00:53:29.460844 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 115/241] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:29 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 28777 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:29.478093 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ebd5d3db-670c-48c2-a029-b958cf7ee55b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:29.479474 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ebd5d3db-670c-48c2-a029-b958cf7ee55b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:29.493789 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ebd5d3db-670c-48c2-a029-b958cf7ee55b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:29.494752 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ebd5d3db-670c-48c2-a029-b958cf7ee55b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:29.496419 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ebd5d3db-670c-48c2-a029-b958cf7ee55b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:29.497321 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ebd5d3db-670c-48c2-a029-b958cf7ee55b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:29.563802 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d6304aa2-c4b2-4efb-a3a5-8ab137cc7c0b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:29.581180 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d6304aa2-c4b2-4efb-a3a5-8ab137cc7c0b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1214 microversion: 2.1 time: 0.148051 Jan 28 00:53:29.583200 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 127/242] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:29 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:29.871954 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-ebd5d3db-670c-48c2-a029-b958cf7ee55b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:29.899803 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ebd5d3db-670c-48c2-a029-b958cf7ee55b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1363 microversion: 2.1 time: 0.433899 Jan 28 00:53:29.902926 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 116/243] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:29 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1363 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:30.444155 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-41cd8e5b-f22b-4f6a-86a9-a8771e6bc959 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:30.445272 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-41cd8e5b-f22b-4f6a-86a9-a8771e6bc959 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:30.475693 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-41cd8e5b-f22b-4f6a-86a9-a8771e6bc959 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:30.479330 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-41cd8e5b-f22b-4f6a-86a9-a8771e6bc959 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:30.482740 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-41cd8e5b-f22b-4f6a-86a9-a8771e6bc959 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:30.488176 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d173611c-cb8b-4f1a-a805-0bbb0dfa804b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:30.490153 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-41cd8e5b-f22b-4f6a-86a9-a8771e6bc959 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:30.491120 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d173611c-cb8b-4f1a-a805-0bbb0dfa804b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:30.508325 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d173611c-cb8b-4f1a-a805-0bbb0dfa804b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:30.508988 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d173611c-cb8b-4f1a-a805-0bbb0dfa804b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:30.510481 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d173611c-cb8b-4f1a-a805-0bbb0dfa804b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:30.511237 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d173611c-cb8b-4f1a-a805-0bbb0dfa804b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:30.702363 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d173611c-cb8b-4f1a-a805-0bbb0dfa804b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 30153 microversion: 2.20 time: 0.221892 Jan 28 00:53:30.709331 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 117/244] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:30 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 30153 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:30.729864 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-41a7f9cb-4d21-4918-ad8b-86f0d4e6460f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:30.731194 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-41a7f9cb-4d21-4918-ad8b-86f0d4e6460f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:30.767540 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-41a7f9cb-4d21-4918-ad8b-86f0d4e6460f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:30.768560 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-41a7f9cb-4d21-4918-ad8b-86f0d4e6460f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:30.772518 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-41a7f9cb-4d21-4918-ad8b-86f0d4e6460f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:30.775933 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-41a7f9cb-4d21-4918-ad8b-86f0d4e6460f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:30.832371 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-41cd8e5b-f22b-4f6a-86a9-a8771e6bc959 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:30.851360 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-41cd8e5b-f22b-4f6a-86a9-a8771e6bc959 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1520 microversion: 2.1 time: 0.412088 Jan 28 00:53:30.864349 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 128/245] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:30 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1520 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:30.958033 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9fa1dfc6-3709-47bb-af75-fd641778b8b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:30.961059 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9fa1dfc6-3709-47bb-af75-fd641778b8b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:30.983305 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9fa1dfc6-3709-47bb-af75-fd641778b8b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:30.987474 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9fa1dfc6-3709-47bb-af75-fd641778b8b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:30.988893 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9fa1dfc6-3709-47bb-af75-fd641778b8b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:30.989763 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9fa1dfc6-3709-47bb-af75-fd641778b8b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:31.006647 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-41a7f9cb-4d21-4918-ad8b-86f0d4e6460f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:31.023018 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-41a7f9cb-4d21-4918-ad8b-86f0d4e6460f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1266 microversion: 2.1 time: 0.306347 Jan 28 00:53:31.024121 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 118/246] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:30 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:31.219636 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-96c6fe07-9eb3-46de-9296-d603890c5bf0 req-b20a1242-35b9-4204-82e3-14c02755c77d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4dbbfd4-609c-4041-b0b5-b939f759eecd", "name": "network-vif-plugged", "status": "completed", "tag": "ec21ff23-6b4d-4c5a-b463-a671e6aea7ed"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:31.227394 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:53:31.227394 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:53:31.247914 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-96c6fe07-9eb3-46de-9296-d603890c5bf0 req-b20a1242-35b9-4204-82e3-14c02755c77d service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:31.248660 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-96c6fe07-9eb3-46de-9296-d603890c5bf0 req-b20a1242-35b9-4204-82e3-14c02755c77d service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:31.319939 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-96c6fe07-9eb3-46de-9296-d603890c5bf0 req-b20a1242-35b9-4204-82e3-14c02755c77d service nova] Creating event network-vif-plugged:ec21ff23-6b4d-4c5a-b463-a671e6aea7ed for instance a4dbbfd4-609c-4041-b0b5-b939f759eecd on hv-cinder-80952 Jan 28 00:53:31.367127 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-96c6fe07-9eb3-46de-9296-d603890c5bf0 req-b20a1242-35b9-4204-82e3-14c02755c77d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157458 Jan 28 00:53:31.368458 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9fa1dfc6-3709-47bb-af75-fd641778b8b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:31.373736 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 119/247] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:53:31.386891 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9fa1dfc6-3709-47bb-af75-fd641778b8b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1363 microversion: 2.1 time: 0.446754 Jan 28 00:53:31.388080 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 129/248] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:30 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1363 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:31.728345 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5158b7d0-f5fd-4dbc-a38e-2f872c31ea88 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:31.730667 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5158b7d0-f5fd-4dbc-a38e-2f872c31ea88 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:31.743131 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5158b7d0-f5fd-4dbc-a38e-2f872c31ea88 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:31.743869 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5158b7d0-f5fd-4dbc-a38e-2f872c31ea88 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:31.744896 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5158b7d0-f5fd-4dbc-a38e-2f872c31ea88 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:31.745570 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5158b7d0-f5fd-4dbc-a38e-2f872c31ea88 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:31.881009 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-436ff36b-5622-4281-8075-eef4e235c26b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:31.882098 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-436ff36b-5622-4281-8075-eef4e235c26b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:31.905827 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-436ff36b-5622-4281-8075-eef4e235c26b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:31.906625 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-436ff36b-5622-4281-8075-eef4e235c26b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:31.908437 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-436ff36b-5622-4281-8075-eef4e235c26b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:31.909584 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-436ff36b-5622-4281-8075-eef4e235c26b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:31.934437 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5158b7d0-f5fd-4dbc-a38e-2f872c31ea88 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 30894 microversion: 2.20 time: 0.213834 Jan 28 00:53:31.935417 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 120/249] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:31 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 30894 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:53:32.060373 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1ef4711c-b836-4e4d-8b4d-cd5f1026e66d tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:32.061737 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-1ef4711c-b836-4e4d-8b4d-cd5f1026e66d tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:32.076160 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1ef4711c-b836-4e4d-8b4d-cd5f1026e66d tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:32.077222 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1ef4711c-b836-4e4d-8b4d-cd5f1026e66d tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:32.079189 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1ef4711c-b836-4e4d-8b4d-cd5f1026e66d tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:32.081513 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1ef4711c-b836-4e4d-8b4d-cd5f1026e66d tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:32.158790 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-436ff36b-5622-4281-8075-eef4e235c26b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:32.173017 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-436ff36b-5622-4281-8075-eef4e235c26b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1500 microversion: 2.1 time: 0.299627 Jan 28 00:53:32.174832 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 130/250] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:31 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1500 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:32.202923 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-24d63342-8572-4751-ae1d-d0cf3ff1885c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:32.203854 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-24d63342-8572-4751-ae1d-d0cf3ff1885c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:32.213517 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-24d63342-8572-4751-ae1d-d0cf3ff1885c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:32.214150 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-24d63342-8572-4751-ae1d-d0cf3ff1885c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:32.215378 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-24d63342-8572-4751-ae1d-d0cf3ff1885c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:32.216008 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-24d63342-8572-4751-ae1d-d0cf3ff1885c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:32.217366 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-1ef4711c-b836-4e4d-8b4d-cd5f1026e66d tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:32.227779 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1ef4711c-b836-4e4d-8b4d-cd5f1026e66d tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1272 microversion: 2.1 time: 0.173633 Jan 28 00:53:32.228534 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 121/251] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:32 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:32.413340 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7e04dbff-6dae-4066-9484-f7cc0604032f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:32.414334 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7e04dbff-6dae-4066-9484-f7cc0604032f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:32.435908 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7e04dbff-6dae-4066-9484-f7cc0604032f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:32.436542 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7e04dbff-6dae-4066-9484-f7cc0604032f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:32.437761 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7e04dbff-6dae-4066-9484-f7cc0604032f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:32.438423 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7e04dbff-6dae-4066-9484-f7cc0604032f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:32.520609 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-24d63342-8572-4751-ae1d-d0cf3ff1885c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:32.552677 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-24d63342-8572-4751-ae1d-d0cf3ff1885c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1515 microversion: 2.1 time: 0.355090 Jan 28 00:53:32.554185 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 131/252] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:32 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1515 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:32.923553 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7e04dbff-6dae-4066-9484-f7cc0604032f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:32.941640 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7e04dbff-6dae-4066-9484-f7cc0604032f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1363 microversion: 2.1 time: 0.534937 Jan 28 00:53:32.945802 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 122/253] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:32 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1363 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:32.957974 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d887952a-d28c-4e62-a58b-2b54b03c6fd7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:32.963497 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d887952a-d28c-4e62-a58b-2b54b03c6fd7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:32.977816 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d887952a-d28c-4e62-a58b-2b54b03c6fd7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:32.978572 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d887952a-d28c-4e62-a58b-2b54b03c6fd7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:32.979968 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d887952a-d28c-4e62-a58b-2b54b03c6fd7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:32.981037 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d887952a-d28c-4e62-a58b-2b54b03c6fd7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:33.171429 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d887952a-d28c-4e62-a58b-2b54b03c6fd7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 31816 microversion: 2.20 time: 0.220641 Jan 28 00:53:33.173151 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 132/254] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:32 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 31816 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:33.260928 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4d42e2f3-aded-4d01-93d6-5fac6d30d668 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:33.262884 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4d42e2f3-aded-4d01-93d6-5fac6d30d668 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:33.277821 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4d42e2f3-aded-4d01-93d6-5fac6d30d668 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:33.279352 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4d42e2f3-aded-4d01-93d6-5fac6d30d668 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:33.281397 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4d42e2f3-aded-4d01-93d6-5fac6d30d668 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:33.282284 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4d42e2f3-aded-4d01-93d6-5fac6d30d668 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:33.454207 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4d42e2f3-aded-4d01-93d6-5fac6d30d668 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:33.477562 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4d42e2f3-aded-4d01-93d6-5fac6d30d668 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1272 microversion: 2.1 time: 0.225405 Jan 28 00:53:33.478921 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 123/255] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:33 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:33.975741 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-25ebaaac-466b-44e1-bed5-16c237db486c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:33.977850 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-25ebaaac-466b-44e1-bed5-16c237db486c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:33.993170 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-25ebaaac-466b-44e1-bed5-16c237db486c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:33.994723 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-25ebaaac-466b-44e1-bed5-16c237db486c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:33.996797 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-25ebaaac-466b-44e1-bed5-16c237db486c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:33.997841 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-25ebaaac-466b-44e1-bed5-16c237db486c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:34.189514 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3010176f-48eb-452e-9c0e-a0d2ef0dfbc1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:34.191495 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-3010176f-48eb-452e-9c0e-a0d2ef0dfbc1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:34.219727 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3010176f-48eb-452e-9c0e-a0d2ef0dfbc1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:34.220555 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3010176f-48eb-452e-9c0e-a0d2ef0dfbc1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:34.225839 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3010176f-48eb-452e-9c0e-a0d2ef0dfbc1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:34.227091 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3010176f-48eb-452e-9c0e-a0d2ef0dfbc1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:34.397240 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3010176f-48eb-452e-9c0e-a0d2ef0dfbc1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 32480 microversion: 2.20 time: 0.214121 Jan 28 00:53:34.398287 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 124/256] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:34 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 32480 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:53:34.414228 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0674d99b-3e5d-4c4a-acdb-110c7989a75a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:34.416713 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0674d99b-3e5d-4c4a-acdb-110c7989a75a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:34.430283 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0674d99b-3e5d-4c4a-acdb-110c7989a75a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:34.431167 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0674d99b-3e5d-4c4a-acdb-110c7989a75a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:34.432646 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0674d99b-3e5d-4c4a-acdb-110c7989a75a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:34.433509 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0674d99b-3e5d-4c4a-acdb-110c7989a75a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:34.480324 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.objects.instance [None req-0674d99b-3e5d-4c4a-acdb-110c7989a75a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lazy-loading 'flavor' on Instance uuid 35f84832-ed83-48ac-a8cb-f3a87abd47bd {{(pid=127863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:53:34.746495 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0674d99b-3e5d-4c4a-acdb-110c7989a75a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "POST /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/action" status: 200 len: 32 microversion: 2.1 time: 0.344536 Jan 28 00:53:34.756990 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 125/257] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:53:34 2022] POST /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/action => generated 32 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:53:34.769576 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3f3eee63-879d-461e-9927-5fdf8a0f1dae tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:34.771161 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-3f3eee63-879d-461e-9927-5fdf8a0f1dae tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:34.791871 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3f3eee63-879d-461e-9927-5fdf8a0f1dae tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:34.793179 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3f3eee63-879d-461e-9927-5fdf8a0f1dae tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:34.795895 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3f3eee63-879d-461e-9927-5fdf8a0f1dae tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:34.796466 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3f3eee63-879d-461e-9927-5fdf8a0f1dae tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:34.853559 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-25ebaaac-466b-44e1-bed5-16c237db486c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:34.869891 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-25ebaaac-466b-44e1-bed5-16c237db486c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1549 microversion: 2.1 time: 0.902696 Jan 28 00:53:34.871185 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 133/258] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:33 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1549 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:34.890513 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-c30e8a8c-6f9b-4ee4-aa6c-5176f956f6fb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:34.897150 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-c30e8a8c-6f9b-4ee4-aa6c-5176f956f6fb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:34.906732 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c30e8a8c-6f9b-4ee4-aa6c-5176f956f6fb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:34.907866 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c30e8a8c-6f9b-4ee4-aa6c-5176f956f6fb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:34.909649 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c30e8a8c-6f9b-4ee4-aa6c-5176f956f6fb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:34.910542 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c30e8a8c-6f9b-4ee4-aa6c-5176f956f6fb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:35.335547 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-3f3eee63-879d-461e-9927-5fdf8a0f1dae tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:35.350928 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3f3eee63-879d-461e-9927-5fdf8a0f1dae tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1314 microversion: 2.1 time: 0.590080 Jan 28 00:53:35.352276 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 126/259] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:34 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:35.369106 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2964ae33-3a1b-42ae-830b-626faddaeb53 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:35.371677 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2964ae33-3a1b-42ae-830b-626faddaeb53 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:35.384025 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2964ae33-3a1b-42ae-830b-626faddaeb53 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:35.384680 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2964ae33-3a1b-42ae-830b-626faddaeb53 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:35.385712 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2964ae33-3a1b-42ae-830b-626faddaeb53 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:35.386334 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2964ae33-3a1b-42ae-830b-626faddaeb53 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:35.411220 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c30e8a8c-6f9b-4ee4-aa6c-5176f956f6fb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:35.447985 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-c30e8a8c-6f9b-4ee4-aa6c-5176f956f6fb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.560093 Jan 28 00:53:35.459304 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 134/260] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:34 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:35.467776 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-2e9cb8e6-a5e0-4364-abd4-47be68eacf29 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:35.469547 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-2e9cb8e6-a5e0-4364-abd4-47be68eacf29 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:35.481816 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2e9cb8e6-a5e0-4364-abd4-47be68eacf29 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:35.490094 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2e9cb8e6-a5e0-4364-abd4-47be68eacf29 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:35.491738 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2e9cb8e6-a5e0-4364-abd4-47be68eacf29 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:35.492776 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2e9cb8e6-a5e0-4364-abd4-47be68eacf29 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:35.623504 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2964ae33-3a1b-42ae-830b-626faddaeb53 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.266613 Jan 28 00:53:35.638754 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 127/261] 10.222.0.25 () {58 vars in 1274 bytes} [Fri Jan 28 00:53:35 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/os-interface => generated 285 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:53:35.654419 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-2e9cb8e6-a5e0-4364-abd4-47be68eacf29 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 33311 microversion: 2.20 time: 0.203303 Jan 28 00:53:35.662051 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 135/262] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:35 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 33311 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:35.930352 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2b35691f-6f54-4b0e-ab3d-93feb503a389 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54de3ce3-de51-4ad9-88f8-add95e8abd76", "device": "/dev/sdb"}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:35.932616 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2b35691f-6f54-4b0e-ab3d-93feb503a389 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:35.945060 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2b35691f-6f54-4b0e-ab3d-93feb503a389 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:35.946531 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2b35691f-6f54-4b0e-ab3d-93feb503a389 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:35.948347 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2b35691f-6f54-4b0e-ab3d-93feb503a389 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:35.949481 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2b35691f-6f54-4b0e-ab3d-93feb503a389 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:36.196511 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-7469e884-9bde-4510-9440-19257ae58605 req-25daf2e9-e6b1-4632-88ea-9f2b74a38e63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e", "tag": "32bf8dc0-2f15-4f39-8459-09d3664314e3"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:36.199360 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:53:36.199360 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:53:36.213686 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-7469e884-9bde-4510-9440-19257ae58605 req-25daf2e9-e6b1-4632-88ea-9f2b74a38e63 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:36.214412 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-7469e884-9bde-4510-9440-19257ae58605 req-25daf2e9-e6b1-4632-88ea-9f2b74a38e63 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:36.234472 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-7469e884-9bde-4510-9440-19257ae58605 req-25daf2e9-e6b1-4632-88ea-9f2b74a38e63 service nova] Creating event network-changed:32bf8dc0-2f15-4f39-8459-09d3664314e3 for instance f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e on hv-cinder-80952 Jan 28 00:53:36.244106 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-7469e884-9bde-4510-9440-19257ae58605 req-25daf2e9-e6b1-4632-88ea-9f2b74a38e63 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051167 Jan 28 00:53:36.245569 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 136/263] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:53:36.386325 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-dfb1d508-fcf5-4f29-9d34-68598d4aa607 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:36.390217 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-dfb1d508-fcf5-4f29-9d34-68598d4aa607 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:36.412895 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-dfb1d508-fcf5-4f29-9d34-68598d4aa607 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:36.413539 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-dfb1d508-fcf5-4f29-9d34-68598d4aa607 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:36.418517 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-dfb1d508-fcf5-4f29-9d34-68598d4aa607 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:36.420642 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-dfb1d508-fcf5-4f29-9d34-68598d4aa607 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:36.586163 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2b35691f-6f54-4b0e-ab3d-93feb503a389 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "POST /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.663372 Jan 28 00:53:36.592761 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 128/264] 10.222.0.25 () {60 vars in 1322 bytes} [Fri Jan 28 00:53:35 2022] POST /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6/os-volume_attachments => generated 194 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:53:36.599620 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f1a2d535-cfe4-4585-991d-9a178621d77c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:36.600649 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f1a2d535-cfe4-4585-991d-9a178621d77c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:36.609341 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f1a2d535-cfe4-4585-991d-9a178621d77c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:36.610208 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f1a2d535-cfe4-4585-991d-9a178621d77c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:36.613027 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f1a2d535-cfe4-4585-991d-9a178621d77c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:36.615486 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f1a2d535-cfe4-4585-991d-9a178621d77c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:37.608620 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-dfb1d508-fcf5-4f29-9d34-68598d4aa607 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:37.622383 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-dfb1d508-fcf5-4f29-9d34-68598d4aa607 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1314 microversion: 2.1 time: 1.243330 Jan 28 00:53:37.623845 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 137/265] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:36 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1314 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:37.644375 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-6d5b293f-2216-4326-8952-f9f2fe072cbd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:37.646258 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-6d5b293f-2216-4326-8952-f9f2fe072cbd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:37.658820 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6d5b293f-2216-4326-8952-f9f2fe072cbd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:37.659958 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6d5b293f-2216-4326-8952-f9f2fe072cbd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:37.661698 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6d5b293f-2216-4326-8952-f9f2fe072cbd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:37.661912 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f1a2d535-cfe4-4585-991d-9a178621d77c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:37.663838 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6d5b293f-2216-4326-8952-f9f2fe072cbd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:37.675694 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f1a2d535-cfe4-4585-991d-9a178621d77c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 1.087140 Jan 28 00:53:37.676614 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 129/266] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:36 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:37.854951 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-6d5b293f-2216-4326-8952-f9f2fe072cbd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 34490 microversion: 2.20 time: 0.228389 Jan 28 00:53:37.857692 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 138/267] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:37 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 34490 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:38.594898 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-813d89a4-af63-4765-bc15-d6b9cfe19fd9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:38.597023 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-813d89a4-af63-4765-bc15-d6b9cfe19fd9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:38.600930 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-a660eff7-adc1-4fd5-a64f-363ed494d597 req-f672ad80-9a5f-4d18-b6f2-629cea91f2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4dbbfd4-609c-4041-b0b5-b939f759eecd", "tag": "ec21ff23-6b4d-4c5a-b463-a671e6aea7ed"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:38.606986 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:53:38.606986 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:53:38.618294 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-813d89a4-af63-4765-bc15-d6b9cfe19fd9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:38.619099 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-813d89a4-af63-4765-bc15-d6b9cfe19fd9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:38.620557 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-813d89a4-af63-4765-bc15-d6b9cfe19fd9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:38.631898 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-a660eff7-adc1-4fd5-a64f-363ed494d597 req-f672ad80-9a5f-4d18-b6f2-629cea91f2f2 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:38.632727 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-a660eff7-adc1-4fd5-a64f-363ed494d597 req-f672ad80-9a5f-4d18-b6f2-629cea91f2f2 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:38.636212 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-813d89a4-af63-4765-bc15-d6b9cfe19fd9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:38.672973 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-a660eff7-adc1-4fd5-a64f-363ed494d597 req-f672ad80-9a5f-4d18-b6f2-629cea91f2f2 service nova] Creating event network-changed:ec21ff23-6b4d-4c5a-b463-a671e6aea7ed for instance a4dbbfd4-609c-4041-b0b5-b939f759eecd on hv-cinder-80952 Jan 28 00:53:38.682146 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-a660eff7-adc1-4fd5-a64f-363ed494d597 req-f672ad80-9a5f-4d18-b6f2-629cea91f2f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086924 Jan 28 00:53:38.684035 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 139/268] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:53:38.695824 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-37b151ea-0cc3-4eaa-8fbf-06b4f13c692b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:38.697204 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-37b151ea-0cc3-4eaa-8fbf-06b4f13c692b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:38.709749 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-37b151ea-0cc3-4eaa-8fbf-06b4f13c692b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:38.710887 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-37b151ea-0cc3-4eaa-8fbf-06b4f13c692b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:38.712637 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-37b151ea-0cc3-4eaa-8fbf-06b4f13c692b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:38.713714 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-37b151ea-0cc3-4eaa-8fbf-06b4f13c692b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:38.952989 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-37b151ea-0cc3-4eaa-8fbf-06b4f13c692b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:38.966536 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-37b151ea-0cc3-4eaa-8fbf-06b4f13c692b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1314 microversion: 2.1 time: 0.280021 Jan 28 00:53:38.967737 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 140/269] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:38 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:38.973827 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-740c198f-7a66-47ed-a03a-378d93ac1809 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:38.974596 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-740c198f-7a66-47ed-a03a-378d93ac1809 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:38.985218 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-740c198f-7a66-47ed-a03a-378d93ac1809 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:38.986849 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-740c198f-7a66-47ed-a03a-378d93ac1809 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:38.988322 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-740c198f-7a66-47ed-a03a-378d93ac1809 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:38.989159 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-740c198f-7a66-47ed-a03a-378d93ac1809 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:39.235027 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-740c198f-7a66-47ed-a03a-378d93ac1809 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:39.252846 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-740c198f-7a66-47ed-a03a-378d93ac1809 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.282270 Jan 28 00:53:39.254008 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 141/270] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:38 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:39.262957 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-c8cbdc72-0f24-4939-89a0-1fe5be49d38b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:39.265114 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-c8cbdc72-0f24-4939-89a0-1fe5be49d38b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:39.278391 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c8cbdc72-0f24-4939-89a0-1fe5be49d38b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:39.279619 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c8cbdc72-0f24-4939-89a0-1fe5be49d38b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:39.281419 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c8cbdc72-0f24-4939-89a0-1fe5be49d38b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:39.282307 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c8cbdc72-0f24-4939-89a0-1fe5be49d38b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:41.107379 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-c8cbdc72-0f24-4939-89a0-1fe5be49d38b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 37074 microversion: 2.20 time: 1.848849 Jan 28 00:53:41.107379 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 142/271] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:39 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 37074 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:41.117367 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-6b34a177-084a-4c11-bdaa-df7ffb170f95 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:41.123944 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-813d89a4-af63-4765-bc15-d6b9cfe19fd9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 14 microversion: 2.1 time: 2.533322 Jan 28 00:53:41.125992 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 130/272] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:53:38 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 14 bytes in 2539 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:53:41.139307 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-05eb4e03-372b-4642-ad09-895cf98b0aef tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:41.139954 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-6b34a177-084a-4c11-bdaa-df7ffb170f95 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:41.145994 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-05eb4e03-372b-4642-ad09-895cf98b0aef tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:41.149407 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6b34a177-084a-4c11-bdaa-df7ffb170f95 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:41.150427 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6b34a177-084a-4c11-bdaa-df7ffb170f95 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:41.151902 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6b34a177-084a-4c11-bdaa-df7ffb170f95 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:41.152696 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6b34a177-084a-4c11-bdaa-df7ffb170f95 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:41.160329 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-05eb4e03-372b-4642-ad09-895cf98b0aef tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:41.160775 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-05eb4e03-372b-4642-ad09-895cf98b0aef tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:41.161581 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-05eb4e03-372b-4642-ad09-895cf98b0aef tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:41.162019 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-05eb4e03-372b-4642-ad09-895cf98b0aef tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:41.697405 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-05eb4e03-372b-4642-ad09-895cf98b0aef tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:41.700478 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-6b34a177-084a-4c11-bdaa-df7ffb170f95 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:41.711411 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-6b34a177-084a-4c11-bdaa-df7ffb170f95 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1314 microversion: 2.1 time: 0.601013 Jan 28 00:53:41.715739 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-05eb4e03-372b-4642-ad09-895cf98b0aef tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.587123 Jan 28 00:53:41.717129 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 131/273] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:41 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:41.724479 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 143/274] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:41 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:42.128678 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-523f955b-9b0e-485c-906b-31d8db9aebff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:42.131503 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-523f955b-9b0e-485c-906b-31d8db9aebff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:42.145701 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-bfd52608-8c84-4877-ba18-ce0df118fad0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:42.149077 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-bfd52608-8c84-4877-ba18-ce0df118fad0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:42.165069 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-523f955b-9b0e-485c-906b-31d8db9aebff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:42.165893 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-523f955b-9b0e-485c-906b-31d8db9aebff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:42.168068 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-523f955b-9b0e-485c-906b-31d8db9aebff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:42.168205 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-523f955b-9b0e-485c-906b-31d8db9aebff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:42.170825 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bfd52608-8c84-4877-ba18-ce0df118fad0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:42.171711 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bfd52608-8c84-4877-ba18-ce0df118fad0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:42.173509 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bfd52608-8c84-4877-ba18-ce0df118fad0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:42.174332 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bfd52608-8c84-4877-ba18-ce0df118fad0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:42.349336 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-bfd52608-8c84-4877-ba18-ce0df118fad0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 14 microversion: 2.1 time: 0.211633 Jan 28 00:53:42.349982 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 144/275] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:53:42 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 14 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:53:42.387070 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-523f955b-9b0e-485c-906b-31d8db9aebff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 37979 microversion: 2.20 time: 0.266556 Jan 28 00:53:42.388296 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 132/276] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:42 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 37979 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:42.734339 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-422d298b-94ff-4b86-917e-d7cae0b91999 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:42.737338 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-422d298b-94ff-4b86-917e-d7cae0b91999 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:42.746234 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a247da19-24d2-4f71-ab8f-f8ef3d05f0e0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:42.746234 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a247da19-24d2-4f71-ab8f-f8ef3d05f0e0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:42.758913 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a247da19-24d2-4f71-ab8f-f8ef3d05f0e0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:42.760294 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a247da19-24d2-4f71-ab8f-f8ef3d05f0e0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:42.761133 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a247da19-24d2-4f71-ab8f-f8ef3d05f0e0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:42.761864 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a247da19-24d2-4f71-ab8f-f8ef3d05f0e0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:42.768185 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-422d298b-94ff-4b86-917e-d7cae0b91999 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:42.768797 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-422d298b-94ff-4b86-917e-d7cae0b91999 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:42.769709 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-422d298b-94ff-4b86-917e-d7cae0b91999 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:42.770207 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-422d298b-94ff-4b86-917e-d7cae0b91999 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:43.060310 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a247da19-24d2-4f71-ab8f-f8ef3d05f0e0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:43.068082 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-422d298b-94ff-4b86-917e-d7cae0b91999 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:43.075224 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a247da19-24d2-4f71-ab8f-f8ef3d05f0e0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.335340 Jan 28 00:53:43.076450 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 133/277] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:42 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:43.082692 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-422d298b-94ff-4b86-917e-d7cae0b91999 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1314 microversion: 2.1 time: 0.352949 Jan 28 00:53:43.085331 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 145/278] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:42 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:43.361768 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-95a6ca23-4187-4892-852b-c766ff9824df tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:43.364846 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-95a6ca23-4187-4892-852b-c766ff9824df tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:43.372722 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-95a6ca23-4187-4892-852b-c766ff9824df tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:43.373784 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-95a6ca23-4187-4892-852b-c766ff9824df tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:43.374946 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-95a6ca23-4187-4892-852b-c766ff9824df tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:43.375625 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-95a6ca23-4187-4892-852b-c766ff9824df tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:43.404252 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-2fa45573-3852-4d74-a6ba-903721e9887f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:43.405906 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-2fa45573-3852-4d74-a6ba-903721e9887f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:43.418375 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2fa45573-3852-4d74-a6ba-903721e9887f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:43.419650 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2fa45573-3852-4d74-a6ba-903721e9887f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:43.420655 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2fa45573-3852-4d74-a6ba-903721e9887f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:43.421497 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2fa45573-3852-4d74-a6ba-903721e9887f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:43.546536 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-95a6ca23-4187-4892-852b-c766ff9824df tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 14 microversion: 2.1 time: 0.189325 Jan 28 00:53:43.547240 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 134/279] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:53:43 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 14 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:53:43.618519 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-2fa45573-3852-4d74-a6ba-903721e9887f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 38175 microversion: 2.20 time: 0.220747 Jan 28 00:53:43.621036 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 146/280] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:43 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 38175 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:44.097374 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-65a1b338-a1b4-4daa-bfaa-af039d39a744 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:44.105384 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9beaba66-36d8-40e2-b779-a1ab62f403db tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:44.106585 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9beaba66-36d8-40e2-b779-a1ab62f403db tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:44.108031 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-65a1b338-a1b4-4daa-bfaa-af039d39a744 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:44.122180 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-65a1b338-a1b4-4daa-bfaa-af039d39a744 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:44.123433 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-65a1b338-a1b4-4daa-bfaa-af039d39a744 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:44.123935 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9beaba66-36d8-40e2-b779-a1ab62f403db tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:44.124695 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9beaba66-36d8-40e2-b779-a1ab62f403db tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:44.125189 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-65a1b338-a1b4-4daa-bfaa-af039d39a744 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:44.126036 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-65a1b338-a1b4-4daa-bfaa-af039d39a744 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:44.126258 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9beaba66-36d8-40e2-b779-a1ab62f403db tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:44.127910 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9beaba66-36d8-40e2-b779-a1ab62f403db tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:44.371565 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9beaba66-36d8-40e2-b779-a1ab62f403db tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:44.385481 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9beaba66-36d8-40e2-b779-a1ab62f403db tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1314 microversion: 2.1 time: 0.284929 Jan 28 00:53:44.387877 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 147/281] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:44 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:44.426463 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-65a1b338-a1b4-4daa-bfaa-af039d39a744 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:44.440790 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-65a1b338-a1b4-4daa-bfaa-af039d39a744 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.347694 Jan 28 00:53:44.442022 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 135/282] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:44 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:44.560399 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-dc4d6329-77d3-4c6b-9459-994e83126baa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:44.563045 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-dc4d6329-77d3-4c6b-9459-994e83126baa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:44.576164 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-dc4d6329-77d3-4c6b-9459-994e83126baa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:44.577105 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-dc4d6329-77d3-4c6b-9459-994e83126baa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:44.578600 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-dc4d6329-77d3-4c6b-9459-994e83126baa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:44.579409 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-dc4d6329-77d3-4c6b-9459-994e83126baa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:44.636133 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-949405e8-d6fe-4cbe-87fd-e52198d733a3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:44.638800 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-949405e8-d6fe-4cbe-87fd-e52198d733a3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:44.655033 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-949405e8-d6fe-4cbe-87fd-e52198d733a3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:44.656157 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-949405e8-d6fe-4cbe-87fd-e52198d733a3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:44.658272 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-949405e8-d6fe-4cbe-87fd-e52198d733a3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:44.659209 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-949405e8-d6fe-4cbe-87fd-e52198d733a3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:44.721456 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-dc4d6329-77d3-4c6b-9459-994e83126baa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 14 microversion: 2.1 time: 0.165019 Jan 28 00:53:44.722982 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 148/283] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:53:44 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:53:44.823088 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-949405e8-d6fe-4cbe-87fd-e52198d733a3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 38175 microversion: 2.20 time: 0.192508 Jan 28 00:53:44.825619 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 136/284] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:44 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 38175 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:45.413333 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-8e6c107d-680b-4b81-97dd-28ca837ccb1f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:45.414211 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-8e6c107d-680b-4b81-97dd-28ca837ccb1f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:45.425613 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8e6c107d-680b-4b81-97dd-28ca837ccb1f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:45.426375 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8e6c107d-680b-4b81-97dd-28ca837ccb1f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:45.427600 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8e6c107d-680b-4b81-97dd-28ca837ccb1f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:45.428675 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8e6c107d-680b-4b81-97dd-28ca837ccb1f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:45.467474 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5f43039f-a634-4a13-9970-5a70bfae650e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:45.469052 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5f43039f-a634-4a13-9970-5a70bfae650e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:45.479506 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5f43039f-a634-4a13-9970-5a70bfae650e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:45.480259 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5f43039f-a634-4a13-9970-5a70bfae650e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:45.481668 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5f43039f-a634-4a13-9970-5a70bfae650e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:45.482343 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5f43039f-a634-4a13-9970-5a70bfae650e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:45.847986 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-8e6c107d-680b-4b81-97dd-28ca837ccb1f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:45.867375 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-8e6c107d-680b-4b81-97dd-28ca837ccb1f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1314 microversion: 2.1 time: 0.459606 Jan 28 00:53:45.870958 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 149/285] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:45 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:45.882595 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-e2f56afe-e0b5-47ec-8f15-f798226a5e35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:45.884813 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-e2f56afe-e0b5-47ec-8f15-f798226a5e35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:45.898384 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-5f43039f-a634-4a13-9970-5a70bfae650e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:45.920212 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5f43039f-a634-4a13-9970-5a70bfae650e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.456564 Jan 28 00:53:45.921473 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 137/286] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:45 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:45.941236 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-552f6e91-383c-492a-b676-fcb0f2300a9d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:45.944870 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-552f6e91-383c-492a-b676-fcb0f2300a9d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:45.951381 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e2f56afe-e0b5-47ec-8f15-f798226a5e35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:45.957820 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e2f56afe-e0b5-47ec-8f15-f798226a5e35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:45.963882 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e2f56afe-e0b5-47ec-8f15-f798226a5e35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:45.965051 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e2f56afe-e0b5-47ec-8f15-f798226a5e35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:45.972265 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-552f6e91-383c-492a-b676-fcb0f2300a9d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:45.973122 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-552f6e91-383c-492a-b676-fcb0f2300a9d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:45.974610 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-552f6e91-383c-492a-b676-fcb0f2300a9d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:45.977390 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-552f6e91-383c-492a-b676-fcb0f2300a9d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:46.162743 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-552f6e91-383c-492a-b676-fcb0f2300a9d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 200 len: 38318 microversion: 2.20 time: 0.239285 Jan 28 00:53:46.163752 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 138/287] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:45 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 38318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:53:46.180406 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-e2f56afe-e0b5-47ec-8f15-f798226a5e35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 14 microversion: 2.1 time: 0.306745 Jan 28 00:53:46.181690 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 150/288] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:53:45 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 14 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:53:46.186228 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-03cc2c4c-501b-4973-aa81-96fb8726d63e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:46.190403 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-03cc2c4c-501b-4973-aa81-96fb8726d63e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:46.202006 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-03cc2c4c-501b-4973-aa81-96fb8726d63e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:46.202006 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-03cc2c4c-501b-4973-aa81-96fb8726d63e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:46.202006 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-03cc2c4c-501b-4973-aa81-96fb8726d63e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:46.202006 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-03cc2c4c-501b-4973-aa81-96fb8726d63e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:46.244863 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-03cc2c4c-501b-4973-aa81-96fb8726d63e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/ips" status: 200 len: 151 microversion: 2.20 time: 0.070120 Jan 28 00:53:46.245793 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 139/289] 10.222.0.25 () {60 vars in 1288 bytes} [Fri Jan 28 00:53:46 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/ips => generated 151 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:53:46.895702 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-e6b40fca-1722-4b6e-8b7f-6660d90b6fe1 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:46.896415 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-e6b40fca-1722-4b6e-8b7f-6660d90b6fe1 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:46.903441 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e6b40fca-1722-4b6e-8b7f-6660d90b6fe1 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:46.903903 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e6b40fca-1722-4b6e-8b7f-6660d90b6fe1 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:46.904707 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e6b40fca-1722-4b6e-8b7f-6660d90b6fe1 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:46.905143 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e6b40fca-1722-4b6e-8b7f-6660d90b6fe1 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:46.951029 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-144954b9-dab1-4c7b-9e16-59b370e73c9e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:46.952473 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-144954b9-dab1-4c7b-9e16-59b370e73c9e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:46.962391 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-144954b9-dab1-4c7b-9e16-59b370e73c9e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:46.963177 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-144954b9-dab1-4c7b-9e16-59b370e73c9e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:46.964348 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-144954b9-dab1-4c7b-9e16-59b370e73c9e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:46.964963 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-144954b9-dab1-4c7b-9e16-59b370e73c9e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:47.143999 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-e6b40fca-1722-4b6e-8b7f-6660d90b6fe1 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:47.155003 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-e6b40fca-1722-4b6e-8b7f-6660d90b6fe1 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1314 microversion: 2.1 time: 0.264101 Jan 28 00:53:47.156438 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 151/290] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:46 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:47.195878 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-8ff16d2f-0e8b-4246-b405-1ea1e5aa393f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:47.196870 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-8ff16d2f-0e8b-4246-b405-1ea1e5aa393f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:47.205855 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8ff16d2f-0e8b-4246-b405-1ea1e5aa393f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:47.206880 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8ff16d2f-0e8b-4246-b405-1ea1e5aa393f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:47.208283 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8ff16d2f-0e8b-4246-b405-1ea1e5aa393f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:47.209060 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8ff16d2f-0e8b-4246-b405-1ea1e5aa393f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:47.242700 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-144954b9-dab1-4c7b-9e16-59b370e73c9e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:47.254270 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-144954b9-dab1-4c7b-9e16-59b370e73c9e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.307358 Jan 28 00:53:47.255194 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 140/291] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:46 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:48.185347 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-600dd95a-d4dc-4a5e-9f9f-1d2f17966f55 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:48.187837 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-600dd95a-d4dc-4a5e-9f9f-1d2f17966f55 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:48.209383 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-600dd95a-d4dc-4a5e-9f9f-1d2f17966f55 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:48.210427 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-600dd95a-d4dc-4a5e-9f9f-1d2f17966f55 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:48.211941 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-600dd95a-d4dc-4a5e-9f9f-1d2f17966f55 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:48.212754 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-600dd95a-d4dc-4a5e-9f9f-1d2f17966f55 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:48.483875 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-600dd95a-d4dc-4a5e-9f9f-1d2f17966f55 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:48.508675 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-600dd95a-d4dc-4a5e-9f9f-1d2f17966f55 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1314 microversion: 2.1 time: 0.330790 Jan 28 00:53:48.509870 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 141/292] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:48 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:48.519005 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0d98027a-a7ce-47b4-a4e9-44e76d140ddb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:48.520378 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0d98027a-a7ce-47b4-a4e9-44e76d140ddb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:48.531629 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0d98027a-a7ce-47b4-a4e9-44e76d140ddb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:48.532758 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0d98027a-a7ce-47b4-a4e9-44e76d140ddb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:48.539407 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0d98027a-a7ce-47b4-a4e9-44e76d140ddb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:48.539407 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0d98027a-a7ce-47b4-a4e9-44e76d140ddb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:49.020723 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-0d98027a-a7ce-47b4-a4e9-44e76d140ddb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:49.031086 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0d98027a-a7ce-47b4-a4e9-44e76d140ddb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.519077 Jan 28 00:53:49.032057 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 142/293] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:48 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:49.303318 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-8ff16d2f-0e8b-4246-b405-1ea1e5aa393f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 14 microversion: 2.1 time: 2.111299 Jan 28 00:53:49.305854 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 152/294] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:53:47 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 14 bytes in 2116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 00:53:49.544646 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-206a2b83-0b66-4f3d-8db0-ae4d31b1e0d1 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:49.545474 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-206a2b83-0b66-4f3d-8db0-ae4d31b1e0d1 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:49.553488 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-206a2b83-0b66-4f3d-8db0-ae4d31b1e0d1 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:49.554084 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-206a2b83-0b66-4f3d-8db0-ae4d31b1e0d1 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:49.555767 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-206a2b83-0b66-4f3d-8db0-ae4d31b1e0d1 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:49.556297 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-206a2b83-0b66-4f3d-8db0-ae4d31b1e0d1 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:49.897559 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-e6f97426-1b89-421f-8704-836e988d78ab req-d4648867-6f13-429c-b83c-f050906c3cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e", "name": "network-vif-plugged", "status": "completed", "tag": "32bf8dc0-2f15-4f39-8459-09d3664314e3"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:49.900398 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:53:49.900398 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:53:49.903480 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-206a2b83-0b66-4f3d-8db0-ae4d31b1e0d1 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:49.935609 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-206a2b83-0b66-4f3d-8db0-ae4d31b1e0d1 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1314 microversion: 2.1 time: 0.401907 Jan 28 00:53:49.942702 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-e6f97426-1b89-421f-8704-836e988d78ab req-d4648867-6f13-429c-b83c-f050906c3cdc service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:49.944851 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-e6f97426-1b89-421f-8704-836e988d78ab req-d4648867-6f13-429c-b83c-f050906c3cdc service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:49.950587 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 143/295] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:49 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:50.003991 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-e6f97426-1b89-421f-8704-836e988d78ab req-d4648867-6f13-429c-b83c-f050906c3cdc service nova] Creating event network-vif-plugged:32bf8dc0-2f15-4f39-8459-09d3664314e3 for instance f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e on hv-cinder-80952 Jan 28 00:53:50.025753 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-e6f97426-1b89-421f-8704-836e988d78ab req-d4648867-6f13-429c-b83c-f050906c3cdc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134994 Jan 28 00:53:50.032102 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 153/296] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:53:50.064208 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3cbd32f7-589c-43b5-91da-99f9741ac380 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:50.067573 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-3cbd32f7-589c-43b5-91da-99f9741ac380 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:50.094471 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3cbd32f7-589c-43b5-91da-99f9741ac380 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:50.095900 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3cbd32f7-589c-43b5-91da-99f9741ac380 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:50.112650 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3cbd32f7-589c-43b5-91da-99f9741ac380 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:50.113482 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3cbd32f7-589c-43b5-91da-99f9741ac380 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:50.352035 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1de16e66-dc1e-4a05-acc2-f373ddbd9b35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:50.354181 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1de16e66-dc1e-4a05-acc2-f373ddbd9b35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:50.469892 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1de16e66-dc1e-4a05-acc2-f373ddbd9b35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:50.478190 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1de16e66-dc1e-4a05-acc2-f373ddbd9b35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:50.483795 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1de16e66-dc1e-4a05-acc2-f373ddbd9b35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:50.485033 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1de16e66-dc1e-4a05-acc2-f373ddbd9b35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:50.649447 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1de16e66-dc1e-4a05-acc2-f373ddbd9b35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 14 microversion: 2.1 time: 0.327534 Jan 28 00:53:50.651639 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 154/297] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:53:50 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 14 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:53:50.959773 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-05fe3c64-81c0-497a-8551-3e01c9c4d24e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:50.960926 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-05fe3c64-81c0-497a-8551-3e01c9c4d24e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:50.969145 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-05fe3c64-81c0-497a-8551-3e01c9c4d24e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:50.969720 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-05fe3c64-81c0-497a-8551-3e01c9c4d24e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:50.971404 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-05fe3c64-81c0-497a-8551-3e01c9c4d24e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:50.972032 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-05fe3c64-81c0-497a-8551-3e01c9c4d24e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:51.057626 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-3cbd32f7-589c-43b5-91da-99f9741ac380 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:51.066157 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3cbd32f7-589c-43b5-91da-99f9741ac380 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 1.010786 Jan 28 00:53:51.067107 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 144/298] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:50 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:51.071946 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-67ca9fab-4407-455c-a0c7-aca53d2c9276 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:51.072760 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-67ca9fab-4407-455c-a0c7-aca53d2c9276 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:51.079820 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-67ca9fab-4407-455c-a0c7-aca53d2c9276 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:51.080856 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-67ca9fab-4407-455c-a0c7-aca53d2c9276 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:51.082297 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-67ca9fab-4407-455c-a0c7-aca53d2c9276 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:51.083044 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-67ca9fab-4407-455c-a0c7-aca53d2c9276 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:51.112929 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.objects.instance [None req-67ca9fab-4407-455c-a0c7-aca53d2c9276 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lazy-loading 'flavor' on Instance uuid 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 {{(pid=127863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:53:51.320677 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-05fe3c64-81c0-497a-8551-3e01c9c4d24e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:51.351365 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-05fe3c64-81c0-497a-8551-3e01c9c4d24e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1314 microversion: 2.1 time: 0.398424 Jan 28 00:53:51.353213 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 155/299] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:50 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:51.571076 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-67ca9fab-4407-455c-a0c7-aca53d2c9276 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 202 len: 0 microversion: 2.20 time: 0.502098 Jan 28 00:53:51.572180 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 145/300] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:53:51 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 00:53:51.583967 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-65da88af-a3ab-4807-8dfd-fa0e8b9f43af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:51.585386 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-65da88af-a3ab-4807-8dfd-fa0e8b9f43af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:51.593562 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-65da88af-a3ab-4807-8dfd-fa0e8b9f43af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:51.594536 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-65da88af-a3ab-4807-8dfd-fa0e8b9f43af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:51.596892 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-65da88af-a3ab-4807-8dfd-fa0e8b9f43af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:51.597634 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-65da88af-a3ab-4807-8dfd-fa0e8b9f43af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:51.687576 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1c5d1e81-533a-4ba8-bbe5-c7e78ce8a6af tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:51.687576 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-1c5d1e81-533a-4ba8-bbe5-c7e78ce8a6af tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:51.690586 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1c5d1e81-533a-4ba8-bbe5-c7e78ce8a6af tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:51.691242 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1c5d1e81-533a-4ba8-bbe5-c7e78ce8a6af tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:51.692867 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1c5d1e81-533a-4ba8-bbe5-c7e78ce8a6af tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:51.693499 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1c5d1e81-533a-4ba8-bbe5-c7e78ce8a6af tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:51.897212 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-65da88af-a3ab-4807-8dfd-fa0e8b9f43af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:51.926083 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-65da88af-a3ab-4807-8dfd-fa0e8b9f43af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:51.933511 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-65da88af-a3ab-4807-8dfd-fa0e8b9f43af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:51.937395 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-65da88af-a3ab-4807-8dfd-fa0e8b9f43af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.358800 Jan 28 00:53:51.939625 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 156/301] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:53:51 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:53:52.097778 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7e0745d2-b287-4ded-b35c-0160fdc385a1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:52.112783 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7e0745d2-b287-4ded-b35c-0160fdc385a1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:52.122039 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7e0745d2-b287-4ded-b35c-0160fdc385a1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:52.123022 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7e0745d2-b287-4ded-b35c-0160fdc385a1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:52.124379 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7e0745d2-b287-4ded-b35c-0160fdc385a1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:52.125175 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7e0745d2-b287-4ded-b35c-0160fdc385a1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:52.433141 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7e0745d2-b287-4ded-b35c-0160fdc385a1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:52.450032 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7e0745d2-b287-4ded-b35c-0160fdc385a1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.366056 Jan 28 00:53:52.452572 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 157/302] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:52 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:52.472603 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d73a205d-26da-47fb-acea-d4522258b319 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:52.482746 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d73a205d-26da-47fb-acea-d4522258b319 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:52.495366 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d73a205d-26da-47fb-acea-d4522258b319 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:52.496495 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d73a205d-26da-47fb-acea-d4522258b319 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:52.499510 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d73a205d-26da-47fb-acea-d4522258b319 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:52.500342 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d73a205d-26da-47fb-acea-d4522258b319 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:52.765525 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d73a205d-26da-47fb-acea-d4522258b319 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:52.781282 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d73a205d-26da-47fb-acea-d4522258b319 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1314 microversion: 2.1 time: 0.326299 Jan 28 00:53:52.782527 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 158/303] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:52 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:52.970702 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3ecec100-480c-4181-bb7f-0f504b0eb0bc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:52.972025 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3ecec100-480c-4181-bb7f-0f504b0eb0bc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:52.982117 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3ecec100-480c-4181-bb7f-0f504b0eb0bc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:52.982775 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3ecec100-480c-4181-bb7f-0f504b0eb0bc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:52.984368 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3ecec100-480c-4181-bb7f-0f504b0eb0bc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:52.985027 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3ecec100-480c-4181-bb7f-0f504b0eb0bc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:53.192289 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3ecec100-480c-4181-bb7f-0f504b0eb0bc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:53.207628 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3ecec100-480c-4181-bb7f-0f504b0eb0bc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:53.210629 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3ecec100-480c-4181-bb7f-0f504b0eb0bc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:53.212856 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3ecec100-480c-4181-bb7f-0f504b0eb0bc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.249609 Jan 28 00:53:53.213870 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 159/304] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:53:52 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:53:53.475315 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-cd1ad277-14eb-441e-b680-6fd1ad83560b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:53.476148 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-cd1ad277-14eb-441e-b680-6fd1ad83560b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:53.501390 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cd1ad277-14eb-441e-b680-6fd1ad83560b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:53.502441 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cd1ad277-14eb-441e-b680-6fd1ad83560b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:53.503547 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cd1ad277-14eb-441e-b680-6fd1ad83560b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:53.504173 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cd1ad277-14eb-441e-b680-6fd1ad83560b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:53.721255 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cd1ad277-14eb-441e-b680-6fd1ad83560b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:53.732240 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-cd1ad277-14eb-441e-b680-6fd1ad83560b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.260817 Jan 28 00:53:53.740789 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 160/305] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:53 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:53.812903 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d4e1c484-44da-4890-9878-6cbfdf22c7a9 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:53.813991 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d4e1c484-44da-4890-9878-6cbfdf22c7a9 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:53.823467 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d4e1c484-44da-4890-9878-6cbfdf22c7a9 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:53.824327 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d4e1c484-44da-4890-9878-6cbfdf22c7a9 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:53.825810 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d4e1c484-44da-4890-9878-6cbfdf22c7a9 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:53.826498 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d4e1c484-44da-4890-9878-6cbfdf22c7a9 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:54.148684 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d4e1c484-44da-4890-9878-6cbfdf22c7a9 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:54.162953 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d4e1c484-44da-4890-9878-6cbfdf22c7a9 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1314 microversion: 2.1 time: 0.358241 Jan 28 00:53:54.164407 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 161/306] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:53 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:54.243392 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9519bc10-f481-4169-b29b-ba96c7e43a3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:54.243392 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9519bc10-f481-4169-b29b-ba96c7e43a3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:54.250713 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9519bc10-f481-4169-b29b-ba96c7e43a3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:54.251629 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9519bc10-f481-4169-b29b-ba96c7e43a3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:54.252470 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9519bc10-f481-4169-b29b-ba96c7e43a3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:54.252936 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9519bc10-f481-4169-b29b-ba96c7e43a3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:54.521132 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9519bc10-f481-4169-b29b-ba96c7e43a3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:54.527132 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1c5d1e81-533a-4ba8-bbe5-c7e78ce8a6af tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 15064 microversion: 2.1 time: 2.855518 Jan 28 00:53:54.534606 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 146/307] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:53:51 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 15064 bytes in 2859 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:53:54.566213 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9519bc10-f481-4169-b29b-ba96c7e43a3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:54.570148 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9519bc10-f481-4169-b29b-ba96c7e43a3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:54.596122 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9519bc10-f481-4169-b29b-ba96c7e43a3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.349162 Jan 28 00:53:54.607567 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 162/308] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:53:54 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:53:54.757106 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-316b125e-180a-4db5-80c9-e8017a5fed06 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:54.758038 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-316b125e-180a-4db5-80c9-e8017a5fed06 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:54.779190 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-316b125e-180a-4db5-80c9-e8017a5fed06 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:54.780384 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-316b125e-180a-4db5-80c9-e8017a5fed06 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:54.781581 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-316b125e-180a-4db5-80c9-e8017a5fed06 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:54.782218 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-316b125e-180a-4db5-80c9-e8017a5fed06 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:55.041082 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-316b125e-180a-4db5-80c9-e8017a5fed06 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:55.061641 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-316b125e-180a-4db5-80c9-e8017a5fed06 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.307949 Jan 28 00:53:55.063345 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 147/309] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:54 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:55.192388 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-75c1398c-6d12-4dd1-820e-a2bc11fc4644 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:55.193652 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-75c1398c-6d12-4dd1-820e-a2bc11fc4644 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:55.206236 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-75c1398c-6d12-4dd1-820e-a2bc11fc4644 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:55.207170 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-75c1398c-6d12-4dd1-820e-a2bc11fc4644 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:55.208853 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-75c1398c-6d12-4dd1-820e-a2bc11fc4644 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:55.209469 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-75c1398c-6d12-4dd1-820e-a2bc11fc4644 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:55.491882 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-75c1398c-6d12-4dd1-820e-a2bc11fc4644 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:55.507138 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-75c1398c-6d12-4dd1-820e-a2bc11fc4644 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1314 microversion: 2.1 time: 0.322672 Jan 28 00:53:55.508337 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 163/310] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:55 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:53:55.544814 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f99a78f6-32a8-4e5b-ae5a-976a5e113870 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:53:55.548795 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f99a78f6-32a8-4e5b-ae5a-976a5e113870 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:55.562605 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f99a78f6-32a8-4e5b-ae5a-976a5e113870 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:55.564207 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f99a78f6-32a8-4e5b-ae5a-976a5e113870 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:55.565354 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f99a78f6-32a8-4e5b-ae5a-976a5e113870 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:55.565887 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f99a78f6-32a8-4e5b-ae5a-976a5e113870 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:55.640618 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-bfa57a5d-7057-49d0-9aa6-21fe509804ca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:55.641206 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-bfa57a5d-7057-49d0-9aa6-21fe509804ca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:55.656159 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bfa57a5d-7057-49d0-9aa6-21fe509804ca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:55.656619 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bfa57a5d-7057-49d0-9aa6-21fe509804ca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:55.658050 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bfa57a5d-7057-49d0-9aa6-21fe509804ca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:55.658721 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bfa57a5d-7057-49d0-9aa6-21fe509804ca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:55.852396 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-bfa57a5d-7057-49d0-9aa6-21fe509804ca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:55.875090 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-bfa57a5d-7057-49d0-9aa6-21fe509804ca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:55.878513 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-bfa57a5d-7057-49d0-9aa6-21fe509804ca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:55.880993 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-bfa57a5d-7057-49d0-9aa6-21fe509804ca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.258559 Jan 28 00:53:55.883335 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 164/311] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:53:55 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:53:56.091775 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d12e3ab2-1a77-4f20-bf42-e1094d480cd9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:56.092843 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d12e3ab2-1a77-4f20-bf42-e1094d480cd9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:56.103124 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d12e3ab2-1a77-4f20-bf42-e1094d480cd9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:56.103899 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d12e3ab2-1a77-4f20-bf42-e1094d480cd9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:56.105457 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d12e3ab2-1a77-4f20-bf42-e1094d480cd9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:56.106127 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d12e3ab2-1a77-4f20-bf42-e1094d480cd9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:56.347496 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d12e3ab2-1a77-4f20-bf42-e1094d480cd9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:56.358075 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d12e3ab2-1a77-4f20-bf42-e1094d480cd9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.273888 Jan 28 00:53:56.359148 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 165/312] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:56 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:56.541371 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-561a0b30-6522-41db-8169-239ee18f755b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:56.542934 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-561a0b30-6522-41db-8169-239ee18f755b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:56.554668 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-561a0b30-6522-41db-8169-239ee18f755b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:56.556012 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-561a0b30-6522-41db-8169-239ee18f755b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:56.557595 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-561a0b30-6522-41db-8169-239ee18f755b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:56.559238 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-561a0b30-6522-41db-8169-239ee18f755b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:56.819583 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-561a0b30-6522-41db-8169-239ee18f755b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:56.828900 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-561a0b30-6522-41db-8169-239ee18f755b tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1314 microversion: 2.1 time: 0.301975 Jan 28 00:53:56.830127 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 166/313] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:56 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:56.920722 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-afa5f4a7-77ac-41b1-8055-df806a662dbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:56.921743 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-afa5f4a7-77ac-41b1-8055-df806a662dbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:56.928666 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-afa5f4a7-77ac-41b1-8055-df806a662dbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:56.929116 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-afa5f4a7-77ac-41b1-8055-df806a662dbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:56.929947 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-afa5f4a7-77ac-41b1-8055-df806a662dbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:56.930387 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-afa5f4a7-77ac-41b1-8055-df806a662dbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:57.178749 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-afa5f4a7-77ac-41b1-8055-df806a662dbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:57.198313 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-afa5f4a7-77ac-41b1-8055-df806a662dbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:57.202798 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-afa5f4a7-77ac-41b1-8055-df806a662dbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:57.205738 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-afa5f4a7-77ac-41b1-8055-df806a662dbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.288666 Jan 28 00:53:57.206677 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 167/314] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:53:56 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:53:57.378910 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4625ac6e-5866-4531-96ef-f844279ce3c8 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:57.379898 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4625ac6e-5866-4531-96ef-f844279ce3c8 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:57.386925 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4625ac6e-5866-4531-96ef-f844279ce3c8 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:57.387727 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4625ac6e-5866-4531-96ef-f844279ce3c8 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:57.388769 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4625ac6e-5866-4531-96ef-f844279ce3c8 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:57.389479 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4625ac6e-5866-4531-96ef-f844279ce3c8 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:57.941159 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4625ac6e-5866-4531-96ef-f844279ce3c8 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:57.956662 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4625ac6e-5866-4531-96ef-f844279ce3c8 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.582269 Jan 28 00:53:57.958070 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 168/315] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:57 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:57.966761 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f1a61a19-8e2f-4899-ac08-8bf03bd74ddc tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:57.967935 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f1a61a19-8e2f-4899-ac08-8bf03bd74ddc tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:57.978924 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f1a61a19-8e2f-4899-ac08-8bf03bd74ddc tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:57.979573 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f1a61a19-8e2f-4899-ac08-8bf03bd74ddc tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:57.980450 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f1a61a19-8e2f-4899-ac08-8bf03bd74ddc tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:57.980887 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f1a61a19-8e2f-4899-ac08-8bf03bd74ddc tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:58.413555 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f1a61a19-8e2f-4899-ac08-8bf03bd74ddc tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:58.432008 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f1a61a19-8e2f-4899-ac08-8bf03bd74ddc tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1314 microversion: 2.1 time: 0.470737 Jan 28 00:53:58.433706 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 169/316] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:57 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:53:58.444598 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d2259e57-84cf-4f14-b3e3-36cb69d7f61e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:58.447850 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d2259e57-84cf-4f14-b3e3-36cb69d7f61e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:58.461192 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d2259e57-84cf-4f14-b3e3-36cb69d7f61e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:58.462014 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d2259e57-84cf-4f14-b3e3-36cb69d7f61e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:58.463535 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d2259e57-84cf-4f14-b3e3-36cb69d7f61e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:58.464567 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d2259e57-84cf-4f14-b3e3-36cb69d7f61e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:58.878606 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d2259e57-84cf-4f14-b3e3-36cb69d7f61e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:58.895406 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d2259e57-84cf-4f14-b3e3-36cb69d7f61e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:58.897975 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d2259e57-84cf-4f14-b3e3-36cb69d7f61e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:53:58.899518 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d2259e57-84cf-4f14-b3e3-36cb69d7f61e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.463914 Jan 28 00:53:58.900618 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 170/317] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:53:58 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:53:58.950883 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f99a78f6-32a8-4e5b-ae5a-976a5e113870 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 19342 microversion: 2.1 time: 3.412131 Jan 28 00:53:58.952352 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 148/318] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:53:55 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 19342 bytes in 3415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:53:58.988668 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-864bac44-0960-4e9f-b09a-c58e4e0bb449 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:58.995768 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-864bac44-0960-4e9f-b09a-c58e4e0bb449 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:59.028980 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-864bac44-0960-4e9f-b09a-c58e4e0bb449 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:59.030575 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-864bac44-0960-4e9f-b09a-c58e4e0bb449 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:59.033250 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-864bac44-0960-4e9f-b09a-c58e4e0bb449 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:59.034138 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-864bac44-0960-4e9f-b09a-c58e4e0bb449 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:59.473504 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3fb87bf5-59d4-49ca-9886-35361993fe12 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:53:59.475557 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-3fb87bf5-59d4-49ca-9886-35361993fe12 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:53:59.552524 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3fb87bf5-59d4-49ca-9886-35361993fe12 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:59.553503 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3fb87bf5-59d4-49ca-9886-35361993fe12 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:53:59.556491 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3fb87bf5-59d4-49ca-9886-35361993fe12 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:53:59.557142 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3fb87bf5-59d4-49ca-9886-35361993fe12 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:00.007168 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-864bac44-0960-4e9f-b09a-c58e4e0bb449 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:00.019546 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-864bac44-0960-4e9f-b09a-c58e4e0bb449 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 1.045149 Jan 28 00:54:00.021557 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 171/319] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:58 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:00.027914 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ce17d918-6204-4a56-86e0-60047c6d1bbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:00.028900 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ce17d918-6204-4a56-86e0-60047c6d1bbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:00.044215 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ce17d918-6204-4a56-86e0-60047c6d1bbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:00.046155 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ce17d918-6204-4a56-86e0-60047c6d1bbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:00.048733 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ce17d918-6204-4a56-86e0-60047c6d1bbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:00.070044 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ce17d918-6204-4a56-86e0-60047c6d1bbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:00.333811 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-3fb87bf5-59d4-49ca-9886-35361993fe12 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:00.356274 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3fb87bf5-59d4-49ca-9886-35361993fe12 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1497 microversion: 2.1 time: 0.907485 Jan 28 00:54:00.357525 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 149/320] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:53:59 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1497 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:00.363137 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-8d93dc93-92c5-4747-85ac-34940d8eae98 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:00.366945 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-8d93dc93-92c5-4747-85ac-34940d8eae98 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:00.374627 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8d93dc93-92c5-4747-85ac-34940d8eae98 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:00.375516 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8d93dc93-92c5-4747-85ac-34940d8eae98 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:00.377618 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8d93dc93-92c5-4747-85ac-34940d8eae98 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:00.378674 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8d93dc93-92c5-4747-85ac-34940d8eae98 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:00.554833 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ce17d918-6204-4a56-86e0-60047c6d1bbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:00.570768 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ce17d918-6204-4a56-86e0-60047c6d1bbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:00.582977 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ce17d918-6204-4a56-86e0-60047c6d1bbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:00.586690 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ce17d918-6204-4a56-86e0-60047c6d1bbc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.562550 Jan 28 00:54:00.599309 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 172/321] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:00 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:00.859613 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-8d93dc93-92c5-4747-85ac-34940d8eae98 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 22977 microversion: 2.1 time: 0.499699 Jan 28 00:54:00.865364 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 150/322] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:00 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 22977 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:01.051098 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-793a353b-f113-4d93-a21e-f444ce9a4b74 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:01.066134 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-793a353b-f113-4d93-a21e-f444ce9a4b74 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:01.086567 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-793a353b-f113-4d93-a21e-f444ce9a4b74 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:01.087420 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-793a353b-f113-4d93-a21e-f444ce9a4b74 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:01.088794 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-793a353b-f113-4d93-a21e-f444ce9a4b74 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:01.089586 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-793a353b-f113-4d93-a21e-f444ce9a4b74 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:01.590789 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-793a353b-f113-4d93-a21e-f444ce9a4b74 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:01.603070 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-793a353b-f113-4d93-a21e-f444ce9a4b74 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.561840 Jan 28 00:54:01.605848 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 173/323] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:01 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:01.636691 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7687b5fc-3538-4af3-a8ef-7a01b2e149ff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:01.640134 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7687b5fc-3538-4af3-a8ef-7a01b2e149ff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:01.652964 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-8d2a22ed-faa7-4e6a-b0d2-c6795bf87a56 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:01.654295 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-8d2a22ed-faa7-4e6a-b0d2-c6795bf87a56 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:01.672078 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7687b5fc-3538-4af3-a8ef-7a01b2e149ff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:01.672552 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7687b5fc-3538-4af3-a8ef-7a01b2e149ff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:01.674399 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7687b5fc-3538-4af3-a8ef-7a01b2e149ff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:01.675197 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7687b5fc-3538-4af3-a8ef-7a01b2e149ff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:01.676319 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8d2a22ed-faa7-4e6a-b0d2-c6795bf87a56 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:01.677580 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8d2a22ed-faa7-4e6a-b0d2-c6795bf87a56 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:01.680806 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8d2a22ed-faa7-4e6a-b0d2-c6795bf87a56 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:01.682900 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8d2a22ed-faa7-4e6a-b0d2-c6795bf87a56 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:01.796184 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-8d2a22ed-faa7-4e6a-b0d2-c6795bf87a56 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Going to try to terminate instance {{(pid=127862) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 00:54:02.058962 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7687b5fc-3538-4af3-a8ef-7a01b2e149ff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:02.076596 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7687b5fc-3538-4af3-a8ef-7a01b2e149ff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:02.089229 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7687b5fc-3538-4af3-a8ef-7a01b2e149ff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:02.095443 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7687b5fc-3538-4af3-a8ef-7a01b2e149ff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.471087 Jan 28 00:54:02.099208 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 151/324] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:01 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:02.108770 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a46be1f4-0ee9-4161-a0bb-bb705f53553e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:02.115799 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a46be1f4-0ee9-4161-a0bb-bb705f53553e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:02.153044 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-8d2a22ed-faa7-4e6a-b0d2-c6795bf87a56 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 204 len: 0 microversion: 2.1 time: 0.500009 Jan 28 00:54:02.154199 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 174/325] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 00:54:01 2022] DELETE /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 00:54:02.168189 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a46be1f4-0ee9-4161-a0bb-bb705f53553e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:02.169819 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a46be1f4-0ee9-4161-a0bb-bb705f53553e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:02.172585 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a46be1f4-0ee9-4161-a0bb-bb705f53553e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:02.174504 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a46be1f4-0ee9-4161-a0bb-bb705f53553e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:02.184799 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ecafd9e0-638d-42c6-a7b7-e77f72aadc1a tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:02.185910 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ecafd9e0-638d-42c6-a7b7-e77f72aadc1a tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:02.211188 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ecafd9e0-638d-42c6-a7b7-e77f72aadc1a tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:02.212956 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ecafd9e0-638d-42c6-a7b7-e77f72aadc1a tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:02.215727 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ecafd9e0-638d-42c6-a7b7-e77f72aadc1a tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:02.216972 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ecafd9e0-638d-42c6-a7b7-e77f72aadc1a tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:02.405539 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a46be1f4-0ee9-4161-a0bb-bb705f53553e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 23798 microversion: 2.1 time: 0.296948 Jan 28 00:54:02.409749 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 152/326] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:02 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 23798 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:02.594503 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ecafd9e0-638d-42c6-a7b7-e77f72aadc1a tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:02.630850 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ecafd9e0-638d-42c6-a7b7-e77f72aadc1a tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1503 microversion: 2.1 time: 0.467973 Jan 28 00:54:02.632670 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 175/327] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:02 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1503 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:02.633022 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2fbbe4c2-9466-4f30-b17a-1b3c069b5189 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:02.634878 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2fbbe4c2-9466-4f30-b17a-1b3c069b5189 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:02.662407 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2fbbe4c2-9466-4f30-b17a-1b3c069b5189 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:02.664595 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2fbbe4c2-9466-4f30-b17a-1b3c069b5189 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:02.667070 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2fbbe4c2-9466-4f30-b17a-1b3c069b5189 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:02.668422 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2fbbe4c2-9466-4f30-b17a-1b3c069b5189 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:03.140343 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-cf1b4c76-8de2-4277-8c3f-cb8e2f201fc5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:03.142733 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-cf1b4c76-8de2-4277-8c3f-cb8e2f201fc5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:03.157940 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-2fbbe4c2-9466-4f30-b17a-1b3c069b5189 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:03.165311 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf1b4c76-8de2-4277-8c3f-cb8e2f201fc5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:03.170214 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf1b4c76-8de2-4277-8c3f-cb8e2f201fc5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:03.179730 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf1b4c76-8de2-4277-8c3f-cb8e2f201fc5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:03.180985 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf1b4c76-8de2-4277-8c3f-cb8e2f201fc5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:03.181868 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2fbbe4c2-9466-4f30-b17a-1b3c069b5189 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1501 microversion: 2.1 time: 0.561016 Jan 28 00:54:03.211553 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 153/328] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:02 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1501 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:54:03.223698 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d6e10215-b713-4c3c-b21c-4e5578916624 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50eee0cf-faa2-4061-b07c-767970f91d2e"}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:03.225398 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d6e10215-b713-4c3c-b21c-4e5578916624 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:03.237007 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d6e10215-b713-4c3c-b21c-4e5578916624 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:03.237562 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d6e10215-b713-4c3c-b21c-4e5578916624 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:03.238478 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d6e10215-b713-4c3c-b21c-4e5578916624 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:03.238936 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d6e10215-b713-4c3c-b21c-4e5578916624 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:03.310630 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-d6e10215-b713-4c3c-b21c-4e5578916624 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] HTTP exception thrown: Cannot 'attach_volume' instance 35f84832-ed83-48ac-a8cb-f3a87abd47bd while it is in vm_state rescued Jan 28 00:54:03.311710 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d6e10215-b713-4c3c-b21c-4e5578916624 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Returning 409 to user: Cannot 'attach_volume' instance 35f84832-ed83-48ac-a8cb-f3a87abd47bd while it is in vm_state rescued {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:54:03.313420 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d6e10215-b713-4c3c-b21c-4e5578916624 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "POST /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.093950 Jan 28 00:54:03.314956 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 154/329] 10.222.0.25 () {60 vars in 1322 bytes} [Fri Jan 28 00:54:03 2022] POST /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/os-volume_attachments => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 28 00:54:03.345420 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-13a41242-935a-4470-92d6-f7b1d16c8890 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:03.346106 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-13a41242-935a-4470-92d6-f7b1d16c8890 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:03.357201 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-13a41242-935a-4470-92d6-f7b1d16c8890 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:03.359568 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-13a41242-935a-4470-92d6-f7b1d16c8890 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:03.365241 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-13a41242-935a-4470-92d6-f7b1d16c8890 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:03.370609 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-13a41242-935a-4470-92d6-f7b1d16c8890 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:03.585879 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cf1b4c76-8de2-4277-8c3f-cb8e2f201fc5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:03.593563 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-13a41242-935a-4470-92d6-f7b1d16c8890 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "POST /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/action" status: 202 len: 0 microversion: 2.1 time: 0.270458 Jan 28 00:54:03.595421 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 155/330] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:03 2022] POST /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:54:03.613673 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-536a06cc-9e06-4144-ad4a-49d220a43239 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:03.613971 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cf1b4c76-8de2-4277-8c3f-cb8e2f201fc5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:03.615157 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-536a06cc-9e06-4144-ad4a-49d220a43239 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:03.616218 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cf1b4c76-8de2-4277-8c3f-cb8e2f201fc5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:03.617535 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-cf1b4c76-8de2-4277-8c3f-cb8e2f201fc5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.486855 Jan 28 00:54:03.620913 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 176/331] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:03 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:03.626201 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9a7dd1c9-57fe-4d98-a416-2543708814a6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:03.627543 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9a7dd1c9-57fe-4d98-a416-2543708814a6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:03.637719 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9a7dd1c9-57fe-4d98-a416-2543708814a6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:03.638191 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9a7dd1c9-57fe-4d98-a416-2543708814a6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:03.639221 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9a7dd1c9-57fe-4d98-a416-2543708814a6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:03.639893 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9a7dd1c9-57fe-4d98-a416-2543708814a6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:03.640654 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-536a06cc-9e06-4144-ad4a-49d220a43239 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:03.641348 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-536a06cc-9e06-4144-ad4a-49d220a43239 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:03.642672 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-536a06cc-9e06-4144-ad4a-49d220a43239 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:03.643815 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-536a06cc-9e06-4144-ad4a-49d220a43239 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:03.837955 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-536a06cc-9e06-4144-ad4a-49d220a43239 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 24627 microversion: 2.1 time: 0.240110 Jan 28 00:54:03.843481 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 156/332] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:03 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 24627 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:03.871159 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-93c0d353-2cf2-41ac-bdf6-c9907570d32e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:03.872749 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-93c0d353-2cf2-41ac-bdf6-c9907570d32e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:03.905503 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-93c0d353-2cf2-41ac-bdf6-c9907570d32e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:03.906135 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-93c0d353-2cf2-41ac-bdf6-c9907570d32e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:03.907797 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-93c0d353-2cf2-41ac-bdf6-c9907570d32e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:03.908795 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-93c0d353-2cf2-41ac-bdf6-c9907570d32e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:03.933314 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.objects.instance [None req-9a7dd1c9-57fe-4d98-a416-2543708814a6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lazy-loading 'services' on Instance uuid 4b14e9c4-567f-45aa-942a-1acae5d9eff6 {{(pid=127862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:54:04.231602 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9a7dd1c9-57fe-4d98-a416-2543708814a6 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6/os-volume_attachments/54de3ce3-de51-4ad9-88f8-add95e8abd76" status: 202 len: 0 microversion: 2.1 time: 0.608717 Jan 28 00:54:04.245265 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 177/333] 10.222.0.25 () {58 vars in 1415 bytes} [Fri Jan 28 00:54:03 2022] DELETE /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6/os-volume_attachments/54de3ce3-de51-4ad9-88f8-add95e8abd76 => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:54:04.257746 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-04b20740-3c53-471a-be2c-75f4ff18d255 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:04.259796 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-04b20740-3c53-471a-be2c-75f4ff18d255 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:04.273395 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-04b20740-3c53-471a-be2c-75f4ff18d255 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:04.274084 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-93c0d353-2cf2-41ac-bdf6-c9907570d32e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:04.275286 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-04b20740-3c53-471a-be2c-75f4ff18d255 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:04.277514 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-04b20740-3c53-471a-be2c-75f4ff18d255 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:04.279112 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-04b20740-3c53-471a-be2c-75f4ff18d255 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:04.311684 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-93c0d353-2cf2-41ac-bdf6-c9907570d32e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1509 microversion: 2.1 time: 0.464310 Jan 28 00:54:04.331594 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 157/334] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:03 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1509 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:04.605874 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-04b20740-3c53-471a-be2c-75f4ff18d255 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:04.637803 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-04b20740-3c53-471a-be2c-75f4ff18d255 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1503 microversion: 2.1 time: 0.385255 Jan 28 00:54:04.651312 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 178/335] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:04 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1503 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:04.651759 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-62b308ae-904f-42d4-b5c5-447f06dcc8c3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:04.651759 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-62b308ae-904f-42d4-b5c5-447f06dcc8c3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:04.660549 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-62b308ae-904f-42d4-b5c5-447f06dcc8c3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:04.661367 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-62b308ae-904f-42d4-b5c5-447f06dcc8c3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:04.662832 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-62b308ae-904f-42d4-b5c5-447f06dcc8c3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:04.663683 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-62b308ae-904f-42d4-b5c5-447f06dcc8c3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:04.869952 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-2ed96470-908f-4d99-acbd-b181b0ceaf14 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:04.871672 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-2ed96470-908f-4d99-acbd-b181b0ceaf14 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:04.885149 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2ed96470-908f-4d99-acbd-b181b0ceaf14 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:04.885985 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2ed96470-908f-4d99-acbd-b181b0ceaf14 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:04.887950 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2ed96470-908f-4d99-acbd-b181b0ceaf14 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:04.888791 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2ed96470-908f-4d99-acbd-b181b0ceaf14 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:04.930528 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-62b308ae-904f-42d4-b5c5-447f06dcc8c3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:04.951798 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-62b308ae-904f-42d4-b5c5-447f06dcc8c3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:04.953741 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-62b308ae-904f-42d4-b5c5-447f06dcc8c3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:04.955788 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-62b308ae-904f-42d4-b5c5-447f06dcc8c3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.317435 Jan 28 00:54:04.956570 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 158/336] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:04 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:54:05.035598 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-2ed96470-908f-4d99-acbd-b181b0ceaf14 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 25339 microversion: 2.1 time: 0.178269 Jan 28 00:54:05.041457 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 179/337] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:04 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 25339 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:54:05.342935 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b9843c82-aa64-419d-bf19-7db0acd0408c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:05.345747 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b9843c82-aa64-419d-bf19-7db0acd0408c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:05.358219 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b9843c82-aa64-419d-bf19-7db0acd0408c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:05.359034 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b9843c82-aa64-419d-bf19-7db0acd0408c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:05.361280 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b9843c82-aa64-419d-bf19-7db0acd0408c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:05.361554 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b9843c82-aa64-419d-bf19-7db0acd0408c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:05.625870 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b9843c82-aa64-419d-bf19-7db0acd0408c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:05.638543 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b9843c82-aa64-419d-bf19-7db0acd0408c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1509 microversion: 2.1 time: 0.299404 Jan 28 00:54:05.639772 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 159/338] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:05 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1509 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:05.679837 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-b662d771-b240-40ed-aade-9e0e93165e56 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:05.681183 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-b662d771-b240-40ed-aade-9e0e93165e56 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:05.696269 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b662d771-b240-40ed-aade-9e0e93165e56 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:05.697353 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b662d771-b240-40ed-aade-9e0e93165e56 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:05.699014 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b662d771-b240-40ed-aade-9e0e93165e56 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:05.700232 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b662d771-b240-40ed-aade-9e0e93165e56 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:05.991096 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7529061e-afad-4db4-93e6-acf413b33527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:05.992741 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7529061e-afad-4db4-93e6-acf413b33527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:06.007018 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7529061e-afad-4db4-93e6-acf413b33527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:06.007768 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7529061e-afad-4db4-93e6-acf413b33527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:06.009134 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7529061e-afad-4db4-93e6-acf413b33527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:06.010404 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7529061e-afad-4db4-93e6-acf413b33527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:06.036646 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-b662d771-b240-40ed-aade-9e0e93165e56 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:06.049611 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-b662d771-b240-40ed-aade-9e0e93165e56 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1503 microversion: 2.1 time: 0.383236 Jan 28 00:54:06.065574 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 180/339] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:05 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1503 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:06.071489 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-74f79184-66f6-4007-81b7-e4854f3e3e30 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:06.074699 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-74f79184-66f6-4007-81b7-e4854f3e3e30 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:06.114734 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-74f79184-66f6-4007-81b7-e4854f3e3e30 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:06.119660 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-74f79184-66f6-4007-81b7-e4854f3e3e30 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:06.121706 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-74f79184-66f6-4007-81b7-e4854f3e3e30 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:06.122663 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-74f79184-66f6-4007-81b7-e4854f3e3e30 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:06.324883 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-74f79184-66f6-4007-81b7-e4854f3e3e30 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 26291 microversion: 2.1 time: 0.256958 Jan 28 00:54:06.325977 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 181/340] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:06 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 26291 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:06.421830 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7529061e-afad-4db4-93e6-acf413b33527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:06.443634 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7529061e-afad-4db4-93e6-acf413b33527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:06.446010 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7529061e-afad-4db4-93e6-acf413b33527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:06.449441 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7529061e-afad-4db4-93e6-acf413b33527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.473815 Jan 28 00:54:06.456363 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 160/341] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:05 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:54:06.668412 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ec4b518f-87e7-4f46-ba4a-9d98ebd4a46c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:06.669445 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ec4b518f-87e7-4f46-ba4a-9d98ebd4a46c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:06.699774 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ec4b518f-87e7-4f46-ba4a-9d98ebd4a46c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:06.704995 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ec4b518f-87e7-4f46-ba4a-9d98ebd4a46c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:06.707775 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ec4b518f-87e7-4f46-ba4a-9d98ebd4a46c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:06.709136 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ec4b518f-87e7-4f46-ba4a-9d98ebd4a46c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:06.812126 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-8481d324-6ff7-443c-b0c5-a653e94beb62 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:06.812808 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-8481d324-6ff7-443c-b0c5-a653e94beb62 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:06.835771 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8481d324-6ff7-443c-b0c5-a653e94beb62 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:06.836273 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8481d324-6ff7-443c-b0c5-a653e94beb62 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:06.837093 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8481d324-6ff7-443c-b0c5-a653e94beb62 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:06.841192 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8481d324-6ff7-443c-b0c5-a653e94beb62 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:06.989403 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-8481d324-6ff7-443c-b0c5-a653e94beb62 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Going to try to terminate instance {{(pid=127863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 00:54:07.036010 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ec4b518f-87e7-4f46-ba4a-9d98ebd4a46c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:07.047343 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ec4b518f-87e7-4f46-ba4a-9d98ebd4a46c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1509 microversion: 2.1 time: 0.385170 Jan 28 00:54:07.048889 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 182/342] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:06 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1509 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:07.111662 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-647d39d3-f711-46a1-b523-f757a8e6920f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:07.122371 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-647d39d3-f711-46a1-b523-f757a8e6920f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:07.142541 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-647d39d3-f711-46a1-b523-f757a8e6920f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:07.144013 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-647d39d3-f711-46a1-b523-f757a8e6920f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:07.147468 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-647d39d3-f711-46a1-b523-f757a8e6920f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:07.148786 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-647d39d3-f711-46a1-b523-f757a8e6920f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:07.190571 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-8481d324-6ff7-443c-b0c5-a653e94beb62 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6" status: 204 len: 0 microversion: 2.1 time: 0.386050 Jan 28 00:54:07.193282 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 161/343] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 00:54:06 2022] DELETE /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 00:54:07.226902 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-04bccf2d-c0bc-436c-8c0d-27b030dce599 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:07.227649 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-04bccf2d-c0bc-436c-8c0d-27b030dce599 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:07.245235 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-04bccf2d-c0bc-436c-8c0d-27b030dce599 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:07.246139 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-04bccf2d-c0bc-436c-8c0d-27b030dce599 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:07.247295 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-04bccf2d-c0bc-436c-8c0d-27b030dce599 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:07.247866 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-04bccf2d-c0bc-436c-8c0d-27b030dce599 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:07.286549 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-647d39d3-f711-46a1-b523-f757a8e6920f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:07.312511 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-647d39d3-f711-46a1-b523-f757a8e6920f tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 200 len: 1461 microversion: 2.1 time: 0.215568 Jan 28 00:54:07.325838 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 183/344] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:07 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 1461 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:07.356088 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7c6f8e94-6171-466f-bc12-153cce4872f2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:07.357118 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7c6f8e94-6171-466f-bc12-153cce4872f2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:07.383929 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7c6f8e94-6171-466f-bc12-153cce4872f2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:07.388840 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7c6f8e94-6171-466f-bc12-153cce4872f2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:07.391015 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7c6f8e94-6171-466f-bc12-153cce4872f2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:07.392087 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7c6f8e94-6171-466f-bc12-153cce4872f2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:07.541835 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-04bccf2d-c0bc-436c-8c0d-27b030dce599 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:07.554941 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-04bccf2d-c0bc-436c-8c0d-27b030dce599 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6" status: 200 len: 1513 microversion: 2.1 time: 0.341656 Jan 28 00:54:07.556164 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 162/345] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:07 2022] GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6 => generated 1513 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:54:07.566971 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-91a111c1-c9bb-49ba-90c5-50c94dbf8056 req-120375f8-7d22-4504-a394-09f46257a51c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e", "name": "network-vif-deleted", "tag": "32bf8dc0-2f15-4f39-8459-09d3664314e3"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:07.570600 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:54:07.570600 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:54:07.582738 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-91a111c1-c9bb-49ba-90c5-50c94dbf8056 req-120375f8-7d22-4504-a394-09f46257a51c service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:07.583890 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-91a111c1-c9bb-49ba-90c5-50c94dbf8056 req-120375f8-7d22-4504-a394-09f46257a51c service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:07.593176 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7c6f8e94-6171-466f-bc12-153cce4872f2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 26906 microversion: 2.1 time: 0.248506 Jan 28 00:54:07.595028 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 184/346] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:07 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 26906 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:07.602872 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-5cd3f639-a00b-4e44-a250-e3449f343c3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:07.603990 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-5cd3f639-a00b-4e44-a250-e3449f343c3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:07.609780 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-91a111c1-c9bb-49ba-90c5-50c94dbf8056 req-120375f8-7d22-4504-a394-09f46257a51c service nova] Creating event network-vif-deleted:32bf8dc0-2f15-4f39-8459-09d3664314e3 for instance f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e on hv-cinder-80952 Jan 28 00:54:07.621218 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5cd3f639-a00b-4e44-a250-e3449f343c3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:07.621218 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5cd3f639-a00b-4e44-a250-e3449f343c3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:07.621218 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5cd3f639-a00b-4e44-a250-e3449f343c3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:07.621828 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-91a111c1-c9bb-49ba-90c5-50c94dbf8056 req-120375f8-7d22-4504-a394-09f46257a51c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060646 Jan 28 00:54:07.621994 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5cd3f639-a00b-4e44-a250-e3449f343c3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:07.622161 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 163/347] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:54:07.903172 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-5cd3f639-a00b-4e44-a250-e3449f343c3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:07.921680 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-5cd3f639-a00b-4e44-a250-e3449f343c3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:07.926245 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-5cd3f639-a00b-4e44-a250-e3449f343c3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:07.928628 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-5cd3f639-a00b-4e44-a250-e3449f343c3d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.331212 Jan 28 00:54:07.929655 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 185/348] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:07 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:07.972355 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-164090f2-a212-461b-a5f9-11a960963511 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Action: 'create', calling method: .version_select at 0x7fbbc25ca8b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2038861869"}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:07.994369 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-164090f2-a212-461b-a5f9-11a960963511 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Getting quotas for project dfca2fc1b6c24ac7910c44e6d7936366. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:54:08.003618 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-164090f2-a212-461b-a5f9-11a960963511 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Getting quotas for user 4a973914214249bebd8bd067a8c21ac3 and project dfca2fc1b6c24ac7910c44e6d7936366. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:54:08.079564 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-6dbb1b86-7944-4cd6-80ac-f92665ea9aba tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:08.081245 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-6dbb1b86-7944-4cd6-80ac-f92665ea9aba tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:08.093787 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6dbb1b86-7944-4cd6-80ac-f92665ea9aba tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:08.094964 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6dbb1b86-7944-4cd6-80ac-f92665ea9aba tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:08.096758 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6dbb1b86-7944-4cd6-80ac-f92665ea9aba tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:08.097791 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6dbb1b86-7944-4cd6-80ac-f92665ea9aba tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:08.397056 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-6dbb1b86-7944-4cd6-80ac-f92665ea9aba tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:08.412442 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-6dbb1b86-7944-4cd6-80ac-f92665ea9aba tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1509 microversion: 2.1 time: 0.341658 Jan 28 00:54:08.425718 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 186/349] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:08 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1509 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:08.444091 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7efb98a3-9941-45b0-9e79-e373cc671cdc tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:08.447049 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7efb98a3-9941-45b0-9e79-e373cc671cdc tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:08.459866 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7efb98a3-9941-45b0-9e79-e373cc671cdc tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:08.460879 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7efb98a3-9941-45b0-9e79-e373cc671cdc tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:08.462513 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7efb98a3-9941-45b0-9e79-e373cc671cdc tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:08.463470 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7efb98a3-9941-45b0-9e79-e373cc671cdc tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:08.501955 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-7efb98a3-9941-45b0-9e79-e373cc671cdc tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] HTTP exception thrown: Instance f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e could not be found. Jan 28 00:54:08.506761 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7efb98a3-9941-45b0-9e79-e373cc671cdc tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Returning 404 to user: Instance f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:54:08.511638 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7efb98a3-9941-45b0-9e79-e373cc671cdc tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e" status: 404 len: 111 microversion: 2.1 time: 0.072635 Jan 28 00:54:08.513319 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 187/350] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:08 2022] GET /compute/v2.1/servers/f5e3f7ef-cfc9-4c56-8e3c-fe133effad1e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:54:08.549351 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-164090f2-a212-461b-a5f9-11a960963511 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Getting quotas for project dfca2fc1b6c24ac7910c44e6d7936366. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:54:08.557209 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-164090f2-a212-461b-a5f9-11a960963511 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Getting quotas for user 4a973914214249bebd8bd067a8c21ac3 and project dfca2fc1b6c24ac7910c44e6d7936366. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:54:08.580719 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-164090f2-a212-461b-a5f9-11a960963511 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.956297 Jan 28 00:54:08.581708 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 164/351] 10.222.0.25 () {60 vars in 1157 bytes} [Fri Jan 28 00:54:07 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:08.592557 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-09a2a642-5408-4a89-ba96-fd6f242b7db3 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:08.594059 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-09a2a642-5408-4a89-ba96-fd6f242b7db3 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:08.606975 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-09a2a642-5408-4a89-ba96-fd6f242b7db3 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:08.608019 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-09a2a642-5408-4a89-ba96-fd6f242b7db3 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:08.609567 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-09a2a642-5408-4a89-ba96-fd6f242b7db3 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:08.610933 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-09a2a642-5408-4a89-ba96-fd6f242b7db3 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:08.617390 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f52d388c-6451-4ecb-8c0b-ac6c276e9db8 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:08.618505 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f52d388c-6451-4ecb-8c0b-ac6c276e9db8 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:08.636017 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f52d388c-6451-4ecb-8c0b-ac6c276e9db8 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:08.636744 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f52d388c-6451-4ecb-8c0b-ac6c276e9db8 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:08.637575 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f52d388c-6451-4ecb-8c0b-ac6c276e9db8 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:08.639725 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f52d388c-6451-4ecb-8c0b-ac6c276e9db8 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:08.806227 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f52d388c-6451-4ecb-8c0b-ac6c276e9db8 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 27324 microversion: 2.1 time: 0.199463 Jan 28 00:54:08.807413 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 165/352] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:08 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 27324 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:54:08.819418 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-6152d82c-e1b5-4f91-95e0-2c4ede18ddf0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-301277752", "imageRef": "7fe09c59-2ff9-4639-b39d-9a474e83ad91", "flavorRef": "452", "networks": [{"uuid": "02897698-e859-4014-9247-4fc6e696d897"}]}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:08.925816 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.network.neutron [None req-6152d82c-e1b5-4f91-95e0-2c4ede18ddf0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] validate_networks() for [('02897698-e859-4014-9247-4fc6e696d897', None, None, None, None, None)] {{(pid=127863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:54:09.050556 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-09a2a642-5408-4a89-ba96-fd6f242b7db3 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:09.089324 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-09a2a642-5408-4a89-ba96-fd6f242b7db3 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6" status: 200 len: 1513 microversion: 2.1 time: 0.504526 Jan 28 00:54:09.110106 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 188/353] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:08 2022] GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6 => generated 1513 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:09.118976 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-23af099e-2ada-4df4-9e5d-a1190a395fa5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:09.119816 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-23af099e-2ada-4df4-9e5d-a1190a395fa5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:09.156067 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-23af099e-2ada-4df4-9e5d-a1190a395fa5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:09.162165 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-23af099e-2ada-4df4-9e5d-a1190a395fa5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:09.166580 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-23af099e-2ada-4df4-9e5d-a1190a395fa5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:09.167066 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-23af099e-2ada-4df4-9e5d-a1190a395fa5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:09.675415 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-23af099e-2ada-4df4-9e5d-a1190a395fa5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:09.717434 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-23af099e-2ada-4df4-9e5d-a1190a395fa5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:09.726278 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-23af099e-2ada-4df4-9e5d-a1190a395fa5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:09.728346 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-23af099e-2ada-4df4-9e5d-a1190a395fa5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.615798 Jan 28 00:54:09.729343 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 189/354] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:09 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:09.756431 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-59c6be64-29db-4a71-9f2b-a459712bbebb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:09.758045 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-59c6be64-29db-4a71-9f2b-a459712bbebb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:09.770700 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-59c6be64-29db-4a71-9f2b-a459712bbebb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:09.772444 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-59c6be64-29db-4a71-9f2b-a459712bbebb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:09.773779 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-59c6be64-29db-4a71-9f2b-a459712bbebb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:09.774683 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-59c6be64-29db-4a71-9f2b-a459712bbebb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:10.009381 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-6152d82c-e1b5-4f91-95e0-2c4ede18ddf0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Flavor limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:54:10.010479 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-6152d82c-e1b5-4f91-95e0-2c4ede18ddf0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Image limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:54:10.012139 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-6152d82c-e1b5-4f91-95e0-2c4ede18ddf0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Flavor pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:54:10.012971 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-6152d82c-e1b5-4f91-95e0-2c4ede18ddf0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Image pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:54:10.013736 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-6152d82c-e1b5-4f91-95e0-2c4ede18ddf0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:54:10.039399 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6152d82c-e1b5-4f91-95e0-2c4ede18ddf0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:10.040727 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6152d82c-e1b5-4f91-95e0-2c4ede18ddf0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:10.041674 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6152d82c-e1b5-4f91-95e0-2c4ede18ddf0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:10.042473 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6152d82c-e1b5-4f91-95e0-2c4ede18ddf0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:10.104248 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-6152d82c-e1b5-4f91-95e0-2c4ede18ddf0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Getting quotas for project 731aa66b74a3493ca730bcd22915d385. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:54:10.110724 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-6152d82c-e1b5-4f91-95e0-2c4ede18ddf0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Getting quotas for user 44a854f3323e4970be40d712bda617c7 and project 731aa66b74a3493ca730bcd22915d385. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:54:10.127201 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-6152d82c-e1b5-4f91-95e0-2c4ede18ddf0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Going to run 1 instances... {{(pid=127863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:54:10.131611 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-6152d82c-e1b5-4f91-95e0-2c4ede18ddf0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fe09c59-2ff9-4639-b39d-9a474e83ad91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:54:10.156296 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-59c6be64-29db-4a71-9f2b-a459712bbebb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:10.183228 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-59c6be64-29db-4a71-9f2b-a459712bbebb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1515 microversion: 2.1 time: 0.437032 Jan 28 00:54:10.183869 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 190/355] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:09 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1515 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:10.202558 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d0ab59f6-597f-4ad9-b13e-768615148a84 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:10.203617 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d0ab59f6-597f-4ad9-b13e-768615148a84 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:10.221748 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-6152d82c-e1b5-4f91-95e0-2c4ede18ddf0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.411670 Jan 28 00:54:10.222719 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 166/356] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 00:54:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 00:54:10.246244 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-8354ad50-1687-44c9-9f0e-3f7fa6e1db5d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:10.251666 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-8354ad50-1687-44c9-9f0e-3f7fa6e1db5d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:10.264571 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d0ab59f6-597f-4ad9-b13e-768615148a84 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:10.265467 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d0ab59f6-597f-4ad9-b13e-768615148a84 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:10.267611 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d0ab59f6-597f-4ad9-b13e-768615148a84 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:10.268475 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d0ab59f6-597f-4ad9-b13e-768615148a84 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:10.274165 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8354ad50-1687-44c9-9f0e-3f7fa6e1db5d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:10.276094 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8354ad50-1687-44c9-9f0e-3f7fa6e1db5d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:10.278946 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8354ad50-1687-44c9-9f0e-3f7fa6e1db5d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:10.281878 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8354ad50-1687-44c9-9f0e-3f7fa6e1db5d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:10.564343 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d0ab59f6-597f-4ad9-b13e-768615148a84 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 27852 microversion: 2.1 time: 0.377778 Jan 28 00:54:10.566233 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 191/357] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:10 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 27852 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:10.588787 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-945bbec4-e357-4cf1-bbf4-6890c16b4288 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:10.589339 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-945bbec4-e357-4cf1-bbf4-6890c16b4288 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:10.754010 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-8354ad50-1687-44c9-9f0e-3f7fa6e1db5d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:10.789421 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-8354ad50-1687-44c9-9f0e-3f7fa6e1db5d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6" status: 200 len: 1513 microversion: 2.1 time: 0.555247 Jan 28 00:54:10.791020 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 167/358] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:10 2022] GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6 => generated 1513 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:10.808322 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-8c43ddf6-09f7-46bc-8080-48c630e956f0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:10.809502 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-8c43ddf6-09f7-46bc-8080-48c630e956f0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:10.830945 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8c43ddf6-09f7-46bc-8080-48c630e956f0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:10.831855 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8c43ddf6-09f7-46bc-8080-48c630e956f0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:10.843431 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-945bbec4-e357-4cf1-bbf4-6890c16b4288 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:10.854219 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8c43ddf6-09f7-46bc-8080-48c630e956f0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:10.857107 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8c43ddf6-09f7-46bc-8080-48c630e956f0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:10.869508 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-945bbec4-e357-4cf1-bbf4-6890c16b4288 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1213 microversion: 2.1 time: 0.301966 Jan 28 00:54:10.883976 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 192/359] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:10 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1213 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:11.419657 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-15da9c7f-2e07-4b9e-aed0-1ca9388e135a req-5b637956-4805-469b-b84c-00fafd38d6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b14e9c4-567f-45aa-942a-1acae5d9eff6", "name": "network-vif-deleted", "tag": "d25cd54a-55bc-4938-b4e0-1fb9bfa8d8f0"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:11.423564 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:54:11.423564 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:54:11.449385 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-15da9c7f-2e07-4b9e-aed0-1ca9388e135a req-5b637956-4805-469b-b84c-00fafd38d6d6 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:11.450069 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-15da9c7f-2e07-4b9e-aed0-1ca9388e135a req-5b637956-4805-469b-b84c-00fafd38d6d6 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:11.485134 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-15da9c7f-2e07-4b9e-aed0-1ca9388e135a req-5b637956-4805-469b-b84c-00fafd38d6d6 service nova] Creating event network-vif-deleted:d25cd54a-55bc-4938-b4e0-1fb9bfa8d8f0 for instance 4b14e9c4-567f-45aa-942a-1acae5d9eff6 on hv-cinder-80952 Jan 28 00:54:11.501143 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-15da9c7f-2e07-4b9e-aed0-1ca9388e135a req-5b637956-4805-469b-b84c-00fafd38d6d6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087992 Jan 28 00:54:11.502762 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 193/360] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:54:11.582083 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-726dda45-0b38-4d7a-8c3a-833eeb96296f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:11.583782 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-726dda45-0b38-4d7a-8c3a-833eeb96296f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:11.586389 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-8c43ddf6-09f7-46bc-8080-48c630e956f0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:11.599645 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-726dda45-0b38-4d7a-8c3a-833eeb96296f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:11.602995 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-726dda45-0b38-4d7a-8c3a-833eeb96296f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:11.605763 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-726dda45-0b38-4d7a-8c3a-833eeb96296f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:11.606804 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-726dda45-0b38-4d7a-8c3a-833eeb96296f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:11.607061 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-8c43ddf6-09f7-46bc-8080-48c630e956f0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:11.609645 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-8c43ddf6-09f7-46bc-8080-48c630e956f0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:11.612414 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-8c43ddf6-09f7-46bc-8080-48c630e956f0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.819381 Jan 28 00:54:11.613710 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 168/361] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:10 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:11.803578 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-726dda45-0b38-4d7a-8c3a-833eeb96296f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 28165 microversion: 2.1 time: 0.226542 Jan 28 00:54:11.804648 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 194/362] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:11 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 28165 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:54:11.816488 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4bd9d5d6-f543-4252-8189-4a2f23d463b9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:11.817396 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4bd9d5d6-f543-4252-8189-4a2f23d463b9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:11.826824 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4bd9d5d6-f543-4252-8189-4a2f23d463b9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:11.827796 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4bd9d5d6-f543-4252-8189-4a2f23d463b9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:11.830666 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4bd9d5d6-f543-4252-8189-4a2f23d463b9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:11.832138 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4bd9d5d6-f543-4252-8189-4a2f23d463b9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:11.903423 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1785c525-7f23-4141-9ee9-c82dbe1b034e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:11.904730 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1785c525-7f23-4141-9ee9-c82dbe1b034e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:11.914196 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4bd9d5d6-f543-4252-8189-4a2f23d463b9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:11.914829 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4bd9d5d6-f543-4252-8189-4a2f23d463b9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:11.916834 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.objects.instance [None req-4bd9d5d6-f543-4252-8189-4a2f23d463b9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lazy-loading 'fault' on Instance uuid 4b14e9c4-567f-45aa-942a-1acae5d9eff6 {{(pid=127863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:54:11.950605 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1785c525-7f23-4141-9ee9-c82dbe1b034e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:11.951512 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1785c525-7f23-4141-9ee9-c82dbe1b034e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:11.952889 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1785c525-7f23-4141-9ee9-c82dbe1b034e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:11.953666 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1785c525-7f23-4141-9ee9-c82dbe1b034e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:11.997923 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4bd9d5d6-f543-4252-8189-4a2f23d463b9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:12.009616 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4bd9d5d6-f543-4252-8189-4a2f23d463b9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6" status: 200 len: 1308 microversion: 2.1 time: 0.199367 Jan 28 00:54:12.010326 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 169/363] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:11 2022] GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6 => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:54:12.161535 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e508e757-359e-49ff-97da-c2ee80bb5414 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:12.176772 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e508e757-359e-49ff-97da-c2ee80bb5414 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:12.178196 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-1785c525-7f23-4141-9ee9-c82dbe1b034e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:12.206408 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1785c525-7f23-4141-9ee9-c82dbe1b034e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1209 microversion: 2.1 time: 0.312974 Jan 28 00:54:12.207561 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e508e757-359e-49ff-97da-c2ee80bb5414 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:12.209828 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 195/364] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:11 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1209 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:12.213233 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e508e757-359e-49ff-97da-c2ee80bb5414 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:12.215188 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e508e757-359e-49ff-97da-c2ee80bb5414 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:12.217718 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e508e757-359e-49ff-97da-c2ee80bb5414 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:12.533745 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e508e757-359e-49ff-97da-c2ee80bb5414 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:12.550659 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e508e757-359e-49ff-97da-c2ee80bb5414 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1515 microversion: 2.1 time: 0.408659 Jan 28 00:54:12.552027 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 170/365] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:12 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1515 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:12.580390 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1bd3cc51-5d92-4a04-a1ea-e784cadb2145 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03f44f18-fd98-4da9-82c3-6af7fcfdb8aa"}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:12.586229 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1bd3cc51-5d92-4a04-a1ea-e784cadb2145 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:12.615351 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1bd3cc51-5d92-4a04-a1ea-e784cadb2145 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:12.616637 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1bd3cc51-5d92-4a04-a1ea-e784cadb2145 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:12.619998 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1bd3cc51-5d92-4a04-a1ea-e784cadb2145 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:12.624773 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1bd3cc51-5d92-4a04-a1ea-e784cadb2145 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:12.639859 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-74cdd7a7-321a-46b2-af39-49c895a0f6fd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:12.644489 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-74cdd7a7-321a-46b2-af39-49c895a0f6fd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:12.692873 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-74cdd7a7-321a-46b2-af39-49c895a0f6fd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:12.693995 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-74cdd7a7-321a-46b2-af39-49c895a0f6fd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:12.695629 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-74cdd7a7-321a-46b2-af39-49c895a0f6fd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:12.706430 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-74cdd7a7-321a-46b2-af39-49c895a0f6fd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:13.164220 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-74cdd7a7-321a-46b2-af39-49c895a0f6fd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:13.194678 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-74cdd7a7-321a-46b2-af39-49c895a0f6fd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:13.205860 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-74cdd7a7-321a-46b2-af39-49c895a0f6fd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:13.208497 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-74cdd7a7-321a-46b2-af39-49c895a0f6fd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.577957 Jan 28 00:54:13.210068 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 171/366] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:12 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:54:13.219517 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-41acb8aa-0773-42a0-99a3-ddd5c0c38492 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:13.221691 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-41acb8aa-0773-42a0-99a3-ddd5c0c38492 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:13.233141 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-41acb8aa-0773-42a0-99a3-ddd5c0c38492 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:13.234580 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-41acb8aa-0773-42a0-99a3-ddd5c0c38492 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:13.238042 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-41acb8aa-0773-42a0-99a3-ddd5c0c38492 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:13.239835 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-41acb8aa-0773-42a0-99a3-ddd5c0c38492 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:13.410579 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-41acb8aa-0773-42a0-99a3-ddd5c0c38492 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 28165 microversion: 2.1 time: 0.197817 Jan 28 00:54:13.412410 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 172/367] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:13 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 28165 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:13.446684 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b2cd19c7-2904-4799-9f02-3d91349248b7 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:13.453017 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b2cd19c7-2904-4799-9f02-3d91349248b7 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 4b14e9c4-567f-45aa-942a-1acae5d9eff6] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:13.481319 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b2cd19c7-2904-4799-9f02-3d91349248b7 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:13.482225 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b2cd19c7-2904-4799-9f02-3d91349248b7 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:13.487712 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b2cd19c7-2904-4799-9f02-3d91349248b7 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:13.488520 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b2cd19c7-2904-4799-9f02-3d91349248b7 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:13.595494 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-b2cd19c7-2904-4799-9f02-3d91349248b7 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] HTTP exception thrown: Instance 4b14e9c4-567f-45aa-942a-1acae5d9eff6 could not be found. Jan 28 00:54:13.599990 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b2cd19c7-2904-4799-9f02-3d91349248b7 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Returning 404 to user: Instance 4b14e9c4-567f-45aa-942a-1acae5d9eff6 could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:54:13.601672 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b2cd19c7-2904-4799-9f02-3d91349248b7 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6" status: 404 len: 111 microversion: 2.1 time: 0.183181 Jan 28 00:54:13.602691 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 173/368] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:13 2022] GET /compute/v2.1/servers/4b14e9c4-567f-45aa-942a-1acae5d9eff6 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:54:13.634607 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-27fd7c4c-843b-436d-9e54-0d537ae2b2c5 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:13.638185 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-27fd7c4c-843b-436d-9e54-0d537ae2b2c5 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:13.661374 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-27fd7c4c-843b-436d-9e54-0d537ae2b2c5 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:13.662183 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-27fd7c4c-843b-436d-9e54-0d537ae2b2c5 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:13.664118 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-27fd7c4c-843b-436d-9e54-0d537ae2b2c5 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:13.665059 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-27fd7c4c-843b-436d-9e54-0d537ae2b2c5 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:13.847585 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1bd3cc51-5d92-4a04-a1ea-e784cadb2145 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "POST /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.273403 Jan 28 00:54:13.851844 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 196/369] 10.222.0.25 () {60 vars in 1322 bytes} [Fri Jan 28 00:54:12 2022] POST /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/os-volume_attachments => generated 194 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:54:13.909028 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-27fd7c4c-843b-436d-9e54-0d537ae2b2c5 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:13.927143 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-27fd7c4c-843b-436d-9e54-0d537ae2b2c5 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1271 microversion: 2.1 time: 0.310020 Jan 28 00:54:13.929654 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 174/370] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:13 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1271 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:14.245027 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4f378d18-55db-43b7-88b7-b84e0dca5a70 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:14.245763 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4f378d18-55db-43b7-88b7-b84e0dca5a70 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:14.265806 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4f378d18-55db-43b7-88b7-b84e0dca5a70 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:14.267471 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4f378d18-55db-43b7-88b7-b84e0dca5a70 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:14.269053 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4f378d18-55db-43b7-88b7-b84e0dca5a70 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:14.269764 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4f378d18-55db-43b7-88b7-b84e0dca5a70 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:14.428924 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a936d580-edc8-4ed8-aa7c-2d438b441680 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:14.430270 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a936d580-edc8-4ed8-aa7c-2d438b441680 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:14.440527 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a936d580-edc8-4ed8-aa7c-2d438b441680 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:14.441030 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a936d580-edc8-4ed8-aa7c-2d438b441680 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:14.442597 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a936d580-edc8-4ed8-aa7c-2d438b441680 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:14.443040 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a936d580-edc8-4ed8-aa7c-2d438b441680 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:14.488140 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4f378d18-55db-43b7-88b7-b84e0dca5a70 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:14.502956 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4f378d18-55db-43b7-88b7-b84e0dca5a70 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:14.504568 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4f378d18-55db-43b7-88b7-b84e0dca5a70 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:14.505776 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4f378d18-55db-43b7-88b7-b84e0dca5a70 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.268338 Jan 28 00:54:14.506385 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 197/371] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:14 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:54:14.577936 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a936d580-edc8-4ed8-aa7c-2d438b441680 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 28392 microversion: 2.1 time: 0.155052 Jan 28 00:54:14.579136 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 175/372] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:14 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 28392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:14.951169 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-5785f2de-a577-4235-81df-c10e15a16088 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:14.953148 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-5785f2de-a577-4235-81df-c10e15a16088 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:14.961845 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5785f2de-a577-4235-81df-c10e15a16088 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:14.963501 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5785f2de-a577-4235-81df-c10e15a16088 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:14.964016 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5785f2de-a577-4235-81df-c10e15a16088 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:14.964576 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5785f2de-a577-4235-81df-c10e15a16088 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:15.115806 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-5785f2de-a577-4235-81df-c10e15a16088 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:15.123485 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-5785f2de-a577-4235-81df-c10e15a16088 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1313 microversion: 2.1 time: 0.177682 Jan 28 00:54:15.124085 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 198/373] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:14 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:54:15.214882 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-076974e5-b02c-42a9-8388-a293f36b403e req-7d307324-eeec-416d-85cd-67fa99112d07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c22805ca-a78b-4f35-89cc-7a4d89369afe", "tag": "f21093fa-e21d-479a-a997-8e4c79bb4778"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:15.216533 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:54:15.216533 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:54:15.226085 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-076974e5-b02c-42a9-8388-a293f36b403e req-7d307324-eeec-416d-85cd-67fa99112d07 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:15.226842 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-076974e5-b02c-42a9-8388-a293f36b403e req-7d307324-eeec-416d-85cd-67fa99112d07 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:15.246470 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-076974e5-b02c-42a9-8388-a293f36b403e req-7d307324-eeec-416d-85cd-67fa99112d07 service nova] Creating event network-changed:f21093fa-e21d-479a-a997-8e4c79bb4778 for instance c22805ca-a78b-4f35-89cc-7a4d89369afe on hv-cinder-80952 Jan 28 00:54:15.251362 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-076974e5-b02c-42a9-8388-a293f36b403e req-7d307324-eeec-416d-85cd-67fa99112d07 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042889 Jan 28 00:54:15.251969 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 176/374] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:54:15.525525 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d9bb9581-fcc0-47d9-9b71-fd19af21c489 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:15.526155 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d9bb9581-fcc0-47d9-9b71-fd19af21c489 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:15.533396 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d9bb9581-fcc0-47d9-9b71-fd19af21c489 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:15.533846 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d9bb9581-fcc0-47d9-9b71-fd19af21c489 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:15.534639 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d9bb9581-fcc0-47d9-9b71-fd19af21c489 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:15.535074 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d9bb9581-fcc0-47d9-9b71-fd19af21c489 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:15.595085 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e8c21216-cba3-404e-b66a-d397ab881986 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:15.595552 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e8c21216-cba3-404e-b66a-d397ab881986 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:15.602696 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e8c21216-cba3-404e-b66a-d397ab881986 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:15.603142 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e8c21216-cba3-404e-b66a-d397ab881986 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:15.603989 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e8c21216-cba3-404e-b66a-d397ab881986 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:15.604424 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e8c21216-cba3-404e-b66a-d397ab881986 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:15.692552 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d9bb9581-fcc0-47d9-9b71-fd19af21c489 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:15.701871 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d9bb9581-fcc0-47d9-9b71-fd19af21c489 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:15.703429 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d9bb9581-fcc0-47d9-9b71-fd19af21c489 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:15.705595 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d9bb9581-fcc0-47d9-9b71-fd19af21c489 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.183763 Jan 28 00:54:15.706177 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 199/375] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:15 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:16.143080 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-34ed2527-ccca-43a5-b48d-670e0439b5f5 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:16.143873 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-34ed2527-ccca-43a5-b48d-670e0439b5f5 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:16.152730 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-34ed2527-ccca-43a5-b48d-670e0439b5f5 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:16.153455 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-34ed2527-ccca-43a5-b48d-670e0439b5f5 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:16.154623 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-34ed2527-ccca-43a5-b48d-670e0439b5f5 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:16.155162 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-34ed2527-ccca-43a5-b48d-670e0439b5f5 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:16.396054 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-34ed2527-ccca-43a5-b48d-670e0439b5f5 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:16.404124 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-34ed2527-ccca-43a5-b48d-670e0439b5f5 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1313 microversion: 2.1 time: 0.266209 Jan 28 00:54:16.404992 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 200/376] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:16 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:16.724449 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-cfa7bd85-29a3-42f9-90e8-ceaff68887be tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:16.724979 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-cfa7bd85-29a3-42f9-90e8-ceaff68887be tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:16.732995 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cfa7bd85-29a3-42f9-90e8-ceaff68887be tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:16.733724 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cfa7bd85-29a3-42f9-90e8-ceaff68887be tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:16.735704 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cfa7bd85-29a3-42f9-90e8-ceaff68887be tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:16.736513 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cfa7bd85-29a3-42f9-90e8-ceaff68887be tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:17.187337 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cfa7bd85-29a3-42f9-90e8-ceaff68887be tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:17.200805 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cfa7bd85-29a3-42f9-90e8-ceaff68887be tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:17.202470 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cfa7bd85-29a3-42f9-90e8-ceaff68887be tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:17.204051 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-cfa7bd85-29a3-42f9-90e8-ceaff68887be tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.483297 Jan 28 00:54:17.204772 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 201/377] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:16 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:54:17.424267 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-5f45a656-4de0-497d-ab16-87c207cdd674 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:17.424952 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-5f45a656-4de0-497d-ab16-87c207cdd674 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:17.433218 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5f45a656-4de0-497d-ab16-87c207cdd674 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:17.433997 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5f45a656-4de0-497d-ab16-87c207cdd674 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:17.435451 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5f45a656-4de0-497d-ab16-87c207cdd674 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:17.436087 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5f45a656-4de0-497d-ab16-87c207cdd674 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:17.647930 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e8c21216-cba3-404e-b66a-d397ab881986 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 28454 microversion: 2.1 time: 2.057884 Jan 28 00:54:17.651419 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 177/378] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:15 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 28454 bytes in 2062 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:17.661794 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-5f45a656-4de0-497d-ab16-87c207cdd674 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:17.678816 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-5f45a656-4de0-497d-ab16-87c207cdd674 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1313 microversion: 2.1 time: 0.257624 Jan 28 00:54:17.678816 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 202/379] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:17 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:54:18.226704 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b98a47aa-844a-443e-b655-6984ce0eb4d5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:18.228172 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b98a47aa-844a-443e-b655-6984ce0eb4d5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:18.239032 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b98a47aa-844a-443e-b655-6984ce0eb4d5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:18.245837 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b98a47aa-844a-443e-b655-6984ce0eb4d5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:18.245837 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b98a47aa-844a-443e-b655-6984ce0eb4d5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:18.245837 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b98a47aa-844a-443e-b655-6984ce0eb4d5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:18.452951 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b98a47aa-844a-443e-b655-6984ce0eb4d5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:18.468153 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b98a47aa-844a-443e-b655-6984ce0eb4d5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:18.471167 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b98a47aa-844a-443e-b655-6984ce0eb4d5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:18.473760 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b98a47aa-844a-443e-b655-6984ce0eb4d5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.251193 Jan 28 00:54:18.474973 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 178/380] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:18 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:54:18.683446 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f5baa942-e585-447e-bfdc-4d4dda1f669e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:18.685451 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f5baa942-e585-447e-bfdc-4d4dda1f669e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:18.707301 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-cea5b5d9-683c-416f-bdac-7e24b308dad9 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:18.708412 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-cea5b5d9-683c-416f-bdac-7e24b308dad9 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:18.720462 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f5baa942-e585-447e-bfdc-4d4dda1f669e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:18.721526 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f5baa942-e585-447e-bfdc-4d4dda1f669e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:18.722933 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f5baa942-e585-447e-bfdc-4d4dda1f669e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:18.723981 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f5baa942-e585-447e-bfdc-4d4dda1f669e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:18.728363 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cea5b5d9-683c-416f-bdac-7e24b308dad9 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:18.730275 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cea5b5d9-683c-416f-bdac-7e24b308dad9 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:18.731573 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cea5b5d9-683c-416f-bdac-7e24b308dad9 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:18.734604 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cea5b5d9-683c-416f-bdac-7e24b308dad9 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:18.863678 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f5baa942-e585-447e-bfdc-4d4dda1f669e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 28505 microversion: 2.1 time: 0.193273 Jan 28 00:54:18.864382 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 203/381] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:18 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 28505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:19.055629 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-cea5b5d9-683c-416f-bdac-7e24b308dad9 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:19.065669 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-cea5b5d9-683c-416f-bdac-7e24b308dad9 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1313 microversion: 2.1 time: 0.364829 Jan 28 00:54:19.066461 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 179/382] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:18 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:54:19.525230 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-cfc67c80-72bc-4a3f-ad0c-f0d851502a8e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:19.526426 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-cfc67c80-72bc-4a3f-ad0c-f0d851502a8e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:19.540576 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cfc67c80-72bc-4a3f-ad0c-f0d851502a8e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:19.541574 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cfc67c80-72bc-4a3f-ad0c-f0d851502a8e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:19.543493 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cfc67c80-72bc-4a3f-ad0c-f0d851502a8e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:19.544538 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cfc67c80-72bc-4a3f-ad0c-f0d851502a8e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:19.793278 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cfc67c80-72bc-4a3f-ad0c-f0d851502a8e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:19.809342 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cfc67c80-72bc-4a3f-ad0c-f0d851502a8e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:19.812888 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cfc67c80-72bc-4a3f-ad0c-f0d851502a8e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:19.815388 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-cfc67c80-72bc-4a3f-ad0c-f0d851502a8e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.297832 Jan 28 00:54:19.816472 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 204/383] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:19 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:19.880111 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-367a9471-421a-4345-afb8-aee48d218cea tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:19.881777 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-367a9471-421a-4345-afb8-aee48d218cea tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:19.895203 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-367a9471-421a-4345-afb8-aee48d218cea tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:19.895772 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-367a9471-421a-4345-afb8-aee48d218cea tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:19.896645 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-367a9471-421a-4345-afb8-aee48d218cea tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:19.897123 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-367a9471-421a-4345-afb8-aee48d218cea tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:20.022830 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-367a9471-421a-4345-afb8-aee48d218cea tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 28622 microversion: 2.1 time: 0.148656 Jan 28 00:54:20.029461 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 180/384] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:19 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 28622 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:20.091859 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d5c7f949-5561-41ae-82be-65f8d9a4bd33 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:20.093363 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d5c7f949-5561-41ae-82be-65f8d9a4bd33 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:20.117580 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d5c7f949-5561-41ae-82be-65f8d9a4bd33 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:20.118370 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d5c7f949-5561-41ae-82be-65f8d9a4bd33 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:20.119452 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d5c7f949-5561-41ae-82be-65f8d9a4bd33 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:20.120075 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d5c7f949-5561-41ae-82be-65f8d9a4bd33 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:20.364823 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d5c7f949-5561-41ae-82be-65f8d9a4bd33 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:20.379468 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d5c7f949-5561-41ae-82be-65f8d9a4bd33 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1313 microversion: 2.1 time: 0.295953 Jan 28 00:54:20.380277 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 205/385] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:20 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:20.846670 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-02b3f52e-543d-428b-826a-b45409b1a01f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:20.847762 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-02b3f52e-543d-428b-826a-b45409b1a01f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:20.858207 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-02b3f52e-543d-428b-826a-b45409b1a01f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:20.858797 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-02b3f52e-543d-428b-826a-b45409b1a01f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:20.860340 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-02b3f52e-543d-428b-826a-b45409b1a01f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:20.861029 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-02b3f52e-543d-428b-826a-b45409b1a01f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:21.037427 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-02b3f52e-543d-428b-826a-b45409b1a01f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:21.040271 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d4e62585-c9c9-4fc9-a3b8-87c8af4b4ee9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:21.041922 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d4e62585-c9c9-4fc9-a3b8-87c8af4b4ee9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:21.047099 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-02b3f52e-543d-428b-826a-b45409b1a01f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:21.054749 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-02b3f52e-543d-428b-826a-b45409b1a01f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:21.054749 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-02b3f52e-543d-428b-826a-b45409b1a01f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.210983 Jan 28 00:54:21.060639 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 181/386] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:20 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:54:21.061614 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d4e62585-c9c9-4fc9-a3b8-87c8af4b4ee9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:21.065211 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d4e62585-c9c9-4fc9-a3b8-87c8af4b4ee9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:21.066527 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d4e62585-c9c9-4fc9-a3b8-87c8af4b4ee9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:21.067483 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d4e62585-c9c9-4fc9-a3b8-87c8af4b4ee9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:21.401129 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a1c8ca5a-cb4e-4fb0-ad8c-c12d112b5f70 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:21.401797 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a1c8ca5a-cb4e-4fb0-ad8c-c12d112b5f70 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:21.410251 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a1c8ca5a-cb4e-4fb0-ad8c-c12d112b5f70 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:21.410713 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a1c8ca5a-cb4e-4fb0-ad8c-c12d112b5f70 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:21.411558 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a1c8ca5a-cb4e-4fb0-ad8c-c12d112b5f70 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:21.412002 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a1c8ca5a-cb4e-4fb0-ad8c-c12d112b5f70 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:21.619754 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a1c8ca5a-cb4e-4fb0-ad8c-c12d112b5f70 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:21.630949 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a1c8ca5a-cb4e-4fb0-ad8c-c12d112b5f70 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1313 microversion: 2.1 time: 0.233390 Jan 28 00:54:21.631638 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 182/387] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:21 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:54:22.074137 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7af2bc80-950d-4d50-9876-0b5366b674af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:22.075116 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7af2bc80-950d-4d50-9876-0b5366b674af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:22.083777 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7af2bc80-950d-4d50-9876-0b5366b674af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:22.084465 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7af2bc80-950d-4d50-9876-0b5366b674af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:22.085643 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7af2bc80-950d-4d50-9876-0b5366b674af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:22.086230 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7af2bc80-950d-4d50-9876-0b5366b674af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:22.256399 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7af2bc80-950d-4d50-9876-0b5366b674af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:22.270281 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7af2bc80-950d-4d50-9876-0b5366b674af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:22.272293 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7af2bc80-950d-4d50-9876-0b5366b674af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:22.273742 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7af2bc80-950d-4d50-9876-0b5366b674af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.204471 Jan 28 00:54:22.274313 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 183/388] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:22 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:54:22.650378 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-161ed5b6-b0c4-43bc-bfdb-e037600be7aa tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:22.651049 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-161ed5b6-b0c4-43bc-bfdb-e037600be7aa tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:22.658921 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-161ed5b6-b0c4-43bc-bfdb-e037600be7aa tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:22.659411 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-161ed5b6-b0c4-43bc-bfdb-e037600be7aa tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:22.660652 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-161ed5b6-b0c4-43bc-bfdb-e037600be7aa tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:22.661223 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-161ed5b6-b0c4-43bc-bfdb-e037600be7aa tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:22.870937 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-161ed5b6-b0c4-43bc-bfdb-e037600be7aa tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:22.884186 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-161ed5b6-b0c4-43bc-bfdb-e037600be7aa tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1313 microversion: 2.1 time: 0.238709 Jan 28 00:54:22.891407 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 184/389] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:22 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:54:23.307070 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-79a36d12-eaec-4d7d-8d11-c0cf357543a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:23.308271 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-79a36d12-eaec-4d7d-8d11-c0cf357543a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:23.322120 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d4e62585-c9c9-4fc9-a3b8-87c8af4b4ee9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 28622 microversion: 2.1 time: 2.286894 Jan 28 00:54:23.323425 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-79a36d12-eaec-4d7d-8d11-c0cf357543a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:23.324261 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-79a36d12-eaec-4d7d-8d11-c0cf357543a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:23.325964 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-79a36d12-eaec-4d7d-8d11-c0cf357543a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:23.327043 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-79a36d12-eaec-4d7d-8d11-c0cf357543a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:23.333898 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 206/390] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:21 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 28622 bytes in 2300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:54:23.574700 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-79a36d12-eaec-4d7d-8d11-c0cf357543a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:23.591514 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-79a36d12-eaec-4d7d-8d11-c0cf357543a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:23.595625 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-79a36d12-eaec-4d7d-8d11-c0cf357543a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:23.598475 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-79a36d12-eaec-4d7d-8d11-c0cf357543a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.298015 Jan 28 00:54:23.599591 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 185/391] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:23 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:54:23.914999 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-77317e6e-c4ff-487d-9e84-ca94b883ea7e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:23.916453 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-77317e6e-c4ff-487d-9e84-ca94b883ea7e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:23.928475 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-77317e6e-c4ff-487d-9e84-ca94b883ea7e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:23.929207 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-77317e6e-c4ff-487d-9e84-ca94b883ea7e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:23.930481 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-77317e6e-c4ff-487d-9e84-ca94b883ea7e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:23.931119 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-77317e6e-c4ff-487d-9e84-ca94b883ea7e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:24.160386 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-77317e6e-c4ff-487d-9e84-ca94b883ea7e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:24.176651 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-77317e6e-c4ff-487d-9e84-ca94b883ea7e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1313 microversion: 2.1 time: 0.266387 Jan 28 00:54:24.177858 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 207/392] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:23 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:24.344808 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ef340ea4-01a7-4ffb-a83c-1970a449933e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:24.347702 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ef340ea4-01a7-4ffb-a83c-1970a449933e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:24.360641 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ef340ea4-01a7-4ffb-a83c-1970a449933e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:24.361502 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ef340ea4-01a7-4ffb-a83c-1970a449933e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:24.362984 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ef340ea4-01a7-4ffb-a83c-1970a449933e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:24.363836 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ef340ea4-01a7-4ffb-a83c-1970a449933e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:24.511051 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ef340ea4-01a7-4ffb-a83c-1970a449933e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 28622 microversion: 2.1 time: 0.173463 Jan 28 00:54:24.512289 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 186/393] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:24 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 28622 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:24.633044 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d3b8d82c-6b02-472f-accc-03ae30bb95af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:24.638712 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d3b8d82c-6b02-472f-accc-03ae30bb95af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:24.650744 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d3b8d82c-6b02-472f-accc-03ae30bb95af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:24.656408 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d3b8d82c-6b02-472f-accc-03ae30bb95af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:24.670963 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d3b8d82c-6b02-472f-accc-03ae30bb95af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:24.671743 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d3b8d82c-6b02-472f-accc-03ae30bb95af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:24.693070 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1f75f7c9-ecfc-485e-8d4b-328a7a602da9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-904415344", "imageRef": "7fe09c59-2ff9-4639-b39d-9a474e83ad91", "flavorRef": "452", "networks": [{"uuid": "2ecb06c8-0460-4a10-8a76-6c7f66642518"}]}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:24.794440 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.network.neutron [None req-1f75f7c9-ecfc-485e-8d4b-328a7a602da9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] validate_networks() for [('2ecb06c8-0460-4a10-8a76-6c7f66642518', None, None, None, None, None)] {{(pid=127863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:54:25.072516 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d3b8d82c-6b02-472f-accc-03ae30bb95af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:25.086878 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d3b8d82c-6b02-472f-accc-03ae30bb95af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:25.088811 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d3b8d82c-6b02-472f-accc-03ae30bb95af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:25.090785 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d3b8d82c-6b02-472f-accc-03ae30bb95af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1744 microversion: 2.20 time: 0.465063 Jan 28 00:54:25.091948 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 208/394] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:24 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1744 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:25.190347 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-6fdcbfa1-c5da-4dd9-acbd-5d264af73240 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:25.191667 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-6fdcbfa1-c5da-4dd9-acbd-5d264af73240 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:25.198893 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6fdcbfa1-c5da-4dd9-acbd-5d264af73240 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:25.199698 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6fdcbfa1-c5da-4dd9-acbd-5d264af73240 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:25.200977 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6fdcbfa1-c5da-4dd9-acbd-5d264af73240 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:25.201613 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6fdcbfa1-c5da-4dd9-acbd-5d264af73240 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:25.230409 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.objects.instance [None req-6fdcbfa1-c5da-4dd9-acbd-5d264af73240 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lazy-loading 'flavor' on Instance uuid 35f84832-ed83-48ac-a8cb-f3a87abd47bd {{(pid=127862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:54:25.476410 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-6fdcbfa1-c5da-4dd9-acbd-5d264af73240 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "POST /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/action" status: 200 len: 32 microversion: 2.1 time: 0.289844 Jan 28 00:54:25.478013 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 209/395] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:25 2022] POST /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/action => generated 32 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:54:25.483412 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-1f75f7c9-ecfc-485e-8d4b-328a7a602da9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Flavor limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:54:25.486512 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-1f75f7c9-ecfc-485e-8d4b-328a7a602da9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Image limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:54:25.487692 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-1f75f7c9-ecfc-485e-8d4b-328a7a602da9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Flavor pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:54:25.488659 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-1f75f7c9-ecfc-485e-8d4b-328a7a602da9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Image pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:54:25.488850 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f7f5af40-7758-424a-8ba8-5018344940b4 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:25.489797 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-1f75f7c9-ecfc-485e-8d4b-328a7a602da9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:54:25.490139 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f7f5af40-7758-424a-8ba8-5018344940b4 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:25.508686 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f7f5af40-7758-424a-8ba8-5018344940b4 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:25.508686 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f7f5af40-7758-424a-8ba8-5018344940b4 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:25.508686 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f7f5af40-7758-424a-8ba8-5018344940b4 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:25.508686 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f7f5af40-7758-424a-8ba8-5018344940b4 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:25.520443 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1f75f7c9-ecfc-485e-8d4b-328a7a602da9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:25.521774 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1f75f7c9-ecfc-485e-8d4b-328a7a602da9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:25.523728 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1f75f7c9-ecfc-485e-8d4b-328a7a602da9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:25.524575 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1f75f7c9-ecfc-485e-8d4b-328a7a602da9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:25.547458 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-1f75f7c9-ecfc-485e-8d4b-328a7a602da9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Getting quotas for project 88c2482fcb9c4c6197bf49eb103a1623. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:54:25.556611 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-1f75f7c9-ecfc-485e-8d4b-328a7a602da9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Getting quotas for user ba8966bcdbbc4e2e8d21a7a917c54108 and project 88c2482fcb9c4c6197bf49eb103a1623. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:54:25.572997 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-1f75f7c9-ecfc-485e-8d4b-328a7a602da9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Going to run 1 instances... {{(pid=127863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:54:25.579492 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-1f75f7c9-ecfc-485e-8d4b-328a7a602da9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fe09c59-2ff9-4639-b39d-9a474e83ad91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:54:25.662822 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1f75f7c9-ecfc-485e-8d4b-328a7a602da9 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.978806 Jan 28 00:54:25.663782 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 187/396] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 00:54:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 00:54:25.668595 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-129ba6de-0cbf-44d1-ae51-5841995f7675 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:25.669215 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-129ba6de-0cbf-44d1-ae51-5841995f7675 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:25.688986 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-129ba6de-0cbf-44d1-ae51-5841995f7675 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:25.689634 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-129ba6de-0cbf-44d1-ae51-5841995f7675 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:25.690453 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-129ba6de-0cbf-44d1-ae51-5841995f7675 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:25.690902 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-129ba6de-0cbf-44d1-ae51-5841995f7675 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:25.915597 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f7f5af40-7758-424a-8ba8-5018344940b4 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:25.927029 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f7f5af40-7758-424a-8ba8-5018344940b4 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1313 microversion: 2.1 time: 0.446464 Jan 28 00:54:25.941703 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 210/397] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:25 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:25.949179 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-29b77967-400b-4dcc-bbac-f6e65252fb1c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:25.951441 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-29b77967-400b-4dcc-bbac-f6e65252fb1c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:25.969998 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-29b77967-400b-4dcc-bbac-f6e65252fb1c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:25.971307 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-29b77967-400b-4dcc-bbac-f6e65252fb1c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:25.973135 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-29b77967-400b-4dcc-bbac-f6e65252fb1c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:25.974228 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-29b77967-400b-4dcc-bbac-f6e65252fb1c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:26.062721 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-129ba6de-0cbf-44d1-ae51-5841995f7675 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:26.077476 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-129ba6de-0cbf-44d1-ae51-5841995f7675 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1567 microversion: 2.1 time: 0.412178 Jan 28 00:54:26.081763 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 188/398] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:25 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1567 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:26.097600 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e4d73fbc-ea44-48c0-8304-0e012f577215 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:26.098127 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e4d73fbc-ea44-48c0-8304-0e012f577215 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:26.164676 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-29b77967-400b-4dcc-bbac-f6e65252fb1c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 28622 microversion: 2.1 time: 0.230299 Jan 28 00:54:26.170207 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 211/399] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:25 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 28622 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:26.199473 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-081f43b4-3df1-41ad-a477-7e52c0bb42f9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:26.200582 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-081f43b4-3df1-41ad-a477-7e52c0bb42f9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:26.220089 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-081f43b4-3df1-41ad-a477-7e52c0bb42f9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:26.221606 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-081f43b4-3df1-41ad-a477-7e52c0bb42f9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:26.223198 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-081f43b4-3df1-41ad-a477-7e52c0bb42f9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:26.224336 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-081f43b4-3df1-41ad-a477-7e52c0bb42f9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:26.303350 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e4d73fbc-ea44-48c0-8304-0e012f577215 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:26.329878 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e4d73fbc-ea44-48c0-8304-0e012f577215 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 200 len: 1218 microversion: 2.1 time: 0.246183 Jan 28 00:54:26.330992 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 189/400] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:26 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 1218 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:26.588178 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-081f43b4-3df1-41ad-a477-7e52c0bb42f9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:26.608565 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-081f43b4-3df1-41ad-a477-7e52c0bb42f9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:26.612595 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-081f43b4-3df1-41ad-a477-7e52c0bb42f9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:26.615564 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-081f43b4-3df1-41ad-a477-7e52c0bb42f9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1744 microversion: 2.20 time: 0.443114 Jan 28 00:54:26.635817 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 212/401] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:26 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1744 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:26.951594 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b32e7375-3d98-484f-b65e-ace19e9fcab0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:26.956403 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b32e7375-3d98-484f-b65e-ace19e9fcab0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:26.963213 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b32e7375-3d98-484f-b65e-ace19e9fcab0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:26.964325 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b32e7375-3d98-484f-b65e-ace19e9fcab0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:26.965398 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b32e7375-3d98-484f-b65e-ace19e9fcab0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:26.966116 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b32e7375-3d98-484f-b65e-ace19e9fcab0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:27.101543 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-42320072-c1cf-420f-b96a-ac40b7f900c3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:27.103027 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-42320072-c1cf-420f-b96a-ac40b7f900c3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:27.116701 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-42320072-c1cf-420f-b96a-ac40b7f900c3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:27.117745 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-42320072-c1cf-420f-b96a-ac40b7f900c3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:27.118902 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-42320072-c1cf-420f-b96a-ac40b7f900c3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:27.119826 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-42320072-c1cf-420f-b96a-ac40b7f900c3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:27.316696 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b32e7375-3d98-484f-b65e-ace19e9fcab0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:27.337740 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b32e7375-3d98-484f-b65e-ace19e9fcab0 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1313 microversion: 2.1 time: 0.390590 Jan 28 00:54:27.340957 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 190/402] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:26 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:27.349725 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-0d3ca764-14dc-4b29-9991-6967326949af req-59f133b1-90de-4b5d-8445-50c7bff7378c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c22805ca-a78b-4f35-89cc-7a4d89369afe", "name": "network-vif-plugged", "status": "completed", "tag": "f21093fa-e21d-479a-a997-8e4c79bb4778"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:27.362852 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:54:27.362852 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:54:27.398983 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-0d3ca764-14dc-4b29-9991-6967326949af req-59f133b1-90de-4b5d-8445-50c7bff7378c service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:27.399824 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-0d3ca764-14dc-4b29-9991-6967326949af req-59f133b1-90de-4b5d-8445-50c7bff7378c service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:27.421624 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-0d3ca764-14dc-4b29-9991-6967326949af req-59f133b1-90de-4b5d-8445-50c7bff7378c service nova] Creating event network-vif-plugged:f21093fa-e21d-479a-a997-8e4c79bb4778 for instance c22805ca-a78b-4f35-89cc-7a4d89369afe on hv-cinder-80952 Jan 28 00:54:27.432397 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-0d3ca764-14dc-4b29-9991-6967326949af req-59f133b1-90de-4b5d-8445-50c7bff7378c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091063 Jan 28 00:54:27.434572 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 191/403] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:54:27.445322 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c902e322-ccff-4a16-b5bd-25ca055db75e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:27.447484 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c902e322-ccff-4a16-b5bd-25ca055db75e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:27.458417 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c902e322-ccff-4a16-b5bd-25ca055db75e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:27.459736 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c902e322-ccff-4a16-b5bd-25ca055db75e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:27.461553 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c902e322-ccff-4a16-b5bd-25ca055db75e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:27.462954 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c902e322-ccff-4a16-b5bd-25ca055db75e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:27.488520 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-42320072-c1cf-420f-b96a-ac40b7f900c3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:27.518830 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-42320072-c1cf-420f-b96a-ac40b7f900c3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1567 microversion: 2.1 time: 0.420182 Jan 28 00:54:27.523346 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 213/404] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:27 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1567 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:27.549102 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-009721b9-4dc4-4598-bf36-6101b00510cb tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:27.550884 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-009721b9-4dc4-4598-bf36-6101b00510cb tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:27.570972 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-009721b9-4dc4-4598-bf36-6101b00510cb tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:27.571934 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-009721b9-4dc4-4598-bf36-6101b00510cb tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:27.573451 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-009721b9-4dc4-4598-bf36-6101b00510cb tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:27.574566 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-009721b9-4dc4-4598-bf36-6101b00510cb tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:27.670140 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c902e322-ccff-4a16-b5bd-25ca055db75e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 28622 microversion: 2.1 time: 0.232352 Jan 28 00:54:27.671256 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 192/405] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:27 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 28622 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:27.686532 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-cb26119d-c653-4d5e-90e3-e51f32efe272 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:27.690684 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-cb26119d-c653-4d5e-90e3-e51f32efe272 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:27.710830 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cb26119d-c653-4d5e-90e3-e51f32efe272 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:27.711509 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cb26119d-c653-4d5e-90e3-e51f32efe272 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:27.712966 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cb26119d-c653-4d5e-90e3-e51f32efe272 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:27.713733 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cb26119d-c653-4d5e-90e3-e51f32efe272 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:27.735167 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-009721b9-4dc4-4598-bf36-6101b00510cb tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:27.768613 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-009721b9-4dc4-4598-bf36-6101b00510cb tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 200 len: 1270 microversion: 2.1 time: 0.242565 Jan 28 00:54:27.785968 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 214/406] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:27 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 1270 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:28.025710 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-cb26119d-c653-4d5e-90e3-e51f32efe272 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:28.045158 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-cb26119d-c653-4d5e-90e3-e51f32efe272 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:28.064534 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-cb26119d-c653-4d5e-90e3-e51f32efe272 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:28.069276 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-cb26119d-c653-4d5e-90e3-e51f32efe272 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1739 microversion: 2.20 time: 0.394382 Jan 28 00:54:28.070751 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 193/407] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:27 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1739 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:28.368956 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-932167fc-2ae2-4d16-ac41-f34793cdc65a tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:28.370475 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-932167fc-2ae2-4d16-ac41-f34793cdc65a tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:28.379781 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-932167fc-2ae2-4d16-ac41-f34793cdc65a tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:28.380229 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-932167fc-2ae2-4d16-ac41-f34793cdc65a tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:28.381263 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-932167fc-2ae2-4d16-ac41-f34793cdc65a tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:28.381911 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-932167fc-2ae2-4d16-ac41-f34793cdc65a tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:28.554386 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4f044c79-c579-4cc3-b52c-7ba656be68ec tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:28.555031 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4f044c79-c579-4cc3-b52c-7ba656be68ec tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:28.571101 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f044c79-c579-4cc3-b52c-7ba656be68ec tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:28.573052 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f044c79-c579-4cc3-b52c-7ba656be68ec tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:28.589495 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f044c79-c579-4cc3-b52c-7ba656be68ec tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:28.590136 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f044c79-c579-4cc3-b52c-7ba656be68ec tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:28.649850 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-932167fc-2ae2-4d16-ac41-f34793cdc65a tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:28.661803 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-932167fc-2ae2-4d16-ac41-f34793cdc65a tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1313 microversion: 2.1 time: 0.296772 Jan 28 00:54:28.662714 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 215/408] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:28 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:54:28.685759 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7664d087-7165-43e9-a8cd-0d543b7a5e3f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:28.687233 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7664d087-7165-43e9-a8cd-0d543b7a5e3f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:28.714254 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7664d087-7165-43e9-a8cd-0d543b7a5e3f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:28.717117 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7664d087-7165-43e9-a8cd-0d543b7a5e3f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:28.720399 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7664d087-7165-43e9-a8cd-0d543b7a5e3f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:28.721021 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7664d087-7165-43e9-a8cd-0d543b7a5e3f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:28.906123 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7664d087-7165-43e9-a8cd-0d543b7a5e3f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 28622 microversion: 2.1 time: 0.225517 Jan 28 00:54:28.906993 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 216/409] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:28 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 28622 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:28.919783 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-91328349-fd8b-47f1-b140-b31b0a47e870 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:28.923573 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-91328349-fd8b-47f1-b140-b31b0a47e870 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:28.955497 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-91328349-fd8b-47f1-b140-b31b0a47e870 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:28.956771 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-91328349-fd8b-47f1-b140-b31b0a47e870 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:28.960815 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-91328349-fd8b-47f1-b140-b31b0a47e870 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:28.964061 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-91328349-fd8b-47f1-b140-b31b0a47e870 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:28.976291 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4f044c79-c579-4cc3-b52c-7ba656be68ec tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:29.020698 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4f044c79-c579-4cc3-b52c-7ba656be68ec tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1567 microversion: 2.1 time: 0.462673 Jan 28 00:54:29.041366 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 194/410] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:28 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1567 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:54:29.100567 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-45def7c3-05fe-4931-8874-5da633e93805 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:29.104304 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-45def7c3-05fe-4931-8874-5da633e93805 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:29.145405 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-45def7c3-05fe-4931-8874-5da633e93805 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:29.150320 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-45def7c3-05fe-4931-8874-5da633e93805 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:29.153930 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-45def7c3-05fe-4931-8874-5da633e93805 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:29.154820 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-45def7c3-05fe-4931-8874-5da633e93805 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:29.234694 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-91328349-fd8b-47f1-b140-b31b0a47e870 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:29.256710 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-91328349-fd8b-47f1-b140-b31b0a47e870 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 200 len: 1276 microversion: 2.1 time: 0.347148 Jan 28 00:54:29.258830 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 217/411] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:28 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 1276 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:29.539894 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-45def7c3-05fe-4931-8874-5da633e93805 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:29.546497 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-03af656d-87ad-49b1-a55a-acce658222ae req-ccd170f8-e74d-4d25-b2b7-d2c318ecad4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4", "name": "network-vif-plugged", "status": "completed", "tag": "83fc2ec7-8030-466d-ac4d-dc369ac1f250"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:29.549949 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:54:29.549949 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:54:29.564356 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-03af656d-87ad-49b1-a55a-acce658222ae req-ccd170f8-e74d-4d25-b2b7-d2c318ecad4a service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:29.565224 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-03af656d-87ad-49b1-a55a-acce658222ae req-ccd170f8-e74d-4d25-b2b7-d2c318ecad4a service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:29.568930 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-45def7c3-05fe-4931-8874-5da633e93805 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:29.572207 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-45def7c3-05fe-4931-8874-5da633e93805 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:29.577223 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-45def7c3-05fe-4931-8874-5da633e93805 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1739 microversion: 2.20 time: 0.485437 Jan 28 00:54:29.585116 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-03af656d-87ad-49b1-a55a-acce658222ae req-ccd170f8-e74d-4d25-b2b7-d2c318ecad4a service nova] Creating event network-vif-plugged:83fc2ec7-8030-466d-ac4d-dc369ac1f250 for instance 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 on hv-cinder-80952 Jan 28 00:54:29.595566 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-03af656d-87ad-49b1-a55a-acce658222ae req-ccd170f8-e74d-4d25-b2b7-d2c318ecad4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055487 Jan 28 00:54:29.596280 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 195/412] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:29 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1739 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:54:29.601455 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 218/413] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:54:29.701146 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f076963b-03b5-4807-9bd8-d7457ae4c87c tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:29.707375 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f076963b-03b5-4807-9bd8-d7457ae4c87c tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:29.728300 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f076963b-03b5-4807-9bd8-d7457ae4c87c tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:29.734165 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f076963b-03b5-4807-9bd8-d7457ae4c87c tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:29.737507 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f076963b-03b5-4807-9bd8-d7457ae4c87c tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:29.752893 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f076963b-03b5-4807-9bd8-d7457ae4c87c tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:29.923958 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7f7491df-9201-40bf-b7fc-4c5942d2f969 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:29.925166 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7f7491df-9201-40bf-b7fc-4c5942d2f969 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:29.947391 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7f7491df-9201-40bf-b7fc-4c5942d2f969 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:29.954868 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7f7491df-9201-40bf-b7fc-4c5942d2f969 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:29.957614 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7f7491df-9201-40bf-b7fc-4c5942d2f969 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:29.958438 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7f7491df-9201-40bf-b7fc-4c5942d2f969 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:30.132883 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7f7491df-9201-40bf-b7fc-4c5942d2f969 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 28953 microversion: 2.1 time: 0.214746 Jan 28 00:54:30.133724 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 219/414] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:29 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 28953 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:30.139674 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9f897b55-b800-4458-a45c-09c1d1405beb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:30.150238 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9f897b55-b800-4458-a45c-09c1d1405beb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:30.168847 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9f897b55-b800-4458-a45c-09c1d1405beb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:30.169216 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9f897b55-b800-4458-a45c-09c1d1405beb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:30.170263 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9f897b55-b800-4458-a45c-09c1d1405beb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:30.170965 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9f897b55-b800-4458-a45c-09c1d1405beb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:30.180178 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f076963b-03b5-4807-9bd8-d7457ae4c87c tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:30.193945 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f076963b-03b5-4807-9bd8-d7457ae4c87c tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1313 microversion: 2.1 time: 0.500238 Jan 28 00:54:30.204946 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 196/415] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:29 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:30.317063 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-20e2fc6d-0665-40f1-9b44-0d1f9301c412 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:30.319015 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-20e2fc6d-0665-40f1-9b44-0d1f9301c412 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:30.368087 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-20e2fc6d-0665-40f1-9b44-0d1f9301c412 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:30.368954 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-20e2fc6d-0665-40f1-9b44-0d1f9301c412 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:30.370461 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-20e2fc6d-0665-40f1-9b44-0d1f9301c412 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:30.371236 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-20e2fc6d-0665-40f1-9b44-0d1f9301c412 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:30.633927 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9f897b55-b800-4458-a45c-09c1d1405beb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:30.653911 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9f897b55-b800-4458-a45c-09c1d1405beb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1567 microversion: 2.1 time: 0.518613 Jan 28 00:54:30.656343 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 220/416] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:30 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1567 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:30.665860 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-5370f292-547b-4fc5-8d36-d9fc0867c103 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:30.667761 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-5370f292-547b-4fc5-8d36-d9fc0867c103 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:30.693312 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5370f292-547b-4fc5-8d36-d9fc0867c103 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:30.694205 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5370f292-547b-4fc5-8d36-d9fc0867c103 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:30.698057 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5370f292-547b-4fc5-8d36-d9fc0867c103 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:30.698782 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5370f292-547b-4fc5-8d36-d9fc0867c103 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:30.718101 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-20e2fc6d-0665-40f1-9b44-0d1f9301c412 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:30.755688 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-20e2fc6d-0665-40f1-9b44-0d1f9301c412 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 200 len: 1318 microversion: 2.1 time: 0.477750 Jan 28 00:54:30.771550 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 197/417] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:30 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 1318 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:30.973434 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-5370f292-547b-4fc5-8d36-d9fc0867c103 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:30.990486 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-5370f292-547b-4fc5-8d36-d9fc0867c103 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:30.992445 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-5370f292-547b-4fc5-8d36-d9fc0867c103 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:30.993819 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-5370f292-547b-4fc5-8d36-d9fc0867c103 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1739 microversion: 2.20 time: 0.332369 Jan 28 00:54:30.994533 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 221/418] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:30 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:31.148346 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0cb05fb3-c52b-4f78-8217-5385ebe526b6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:31.149748 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0cb05fb3-c52b-4f78-8217-5385ebe526b6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:31.157420 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0cb05fb3-c52b-4f78-8217-5385ebe526b6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:31.158374 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0cb05fb3-c52b-4f78-8217-5385ebe526b6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:31.159557 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0cb05fb3-c52b-4f78-8217-5385ebe526b6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:31.160265 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0cb05fb3-c52b-4f78-8217-5385ebe526b6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:31.216179 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-91c34000-8a15-445c-bfa3-308fd12c97db tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:31.219423 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-91c34000-8a15-445c-bfa3-308fd12c97db tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:31.227707 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-91c34000-8a15-445c-bfa3-308fd12c97db tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:31.228806 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-91c34000-8a15-445c-bfa3-308fd12c97db tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:31.229891 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-91c34000-8a15-445c-bfa3-308fd12c97db tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:31.230831 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-91c34000-8a15-445c-bfa3-308fd12c97db tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:31.305049 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0cb05fb3-c52b-4f78-8217-5385ebe526b6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 30573 microversion: 2.1 time: 0.161281 Jan 28 00:54:31.307157 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 198/419] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:31 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 30573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:54:31.547494 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-91c34000-8a15-445c-bfa3-308fd12c97db tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:31.571247 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-91c34000-8a15-445c-bfa3-308fd12c97db tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1496 microversion: 2.1 time: 0.361913 Jan 28 00:54:31.573086 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 222/420] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:31 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1496 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:54:31.688701 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f33d9de6-64ed-4e42-b612-c46cd692af7d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:31.690069 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f33d9de6-64ed-4e42-b612-c46cd692af7d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:31.731830 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f33d9de6-64ed-4e42-b612-c46cd692af7d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:31.733133 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f33d9de6-64ed-4e42-b612-c46cd692af7d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:31.745863 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f33d9de6-64ed-4e42-b612-c46cd692af7d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:31.745863 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f33d9de6-64ed-4e42-b612-c46cd692af7d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:31.787508 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-07a4cbfa-3064-4da9-9422-7514b065d2b5 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:31.792038 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-07a4cbfa-3064-4da9-9422-7514b065d2b5 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:31.818332 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-07a4cbfa-3064-4da9-9422-7514b065d2b5 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:31.820038 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-07a4cbfa-3064-4da9-9422-7514b065d2b5 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:31.822857 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-07a4cbfa-3064-4da9-9422-7514b065d2b5 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:31.826439 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-07a4cbfa-3064-4da9-9422-7514b065d2b5 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:32.296004 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f33d9de6-64ed-4e42-b612-c46cd692af7d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:32.336405 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f33d9de6-64ed-4e42-b612-c46cd692af7d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1567 microversion: 2.1 time: 0.661975 Jan 28 00:54:32.356029 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 199/421] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:31 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1567 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:32.367868 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ff4e4796-e064-4840-8c93-035ad6d1031f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:32.369101 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ff4e4796-e064-4840-8c93-035ad6d1031f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:32.392168 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ff4e4796-e064-4840-8c93-035ad6d1031f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:32.393106 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ff4e4796-e064-4840-8c93-035ad6d1031f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:32.394603 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ff4e4796-e064-4840-8c93-035ad6d1031f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:32.399832 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ff4e4796-e064-4840-8c93-035ad6d1031f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:32.705374 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-07a4cbfa-3064-4da9-9422-7514b065d2b5 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:32.729113 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-07a4cbfa-3064-4da9-9422-7514b065d2b5 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 200 len: 1318 microversion: 2.1 time: 0.951108 Jan 28 00:54:32.744299 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 223/422] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:31 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 1318 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:54:32.785898 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-6c69c9f5-b507-4e77-92b7-a11d9f72f172 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:32.788037 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-6c69c9f5-b507-4e77-92b7-a11d9f72f172 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:32.805678 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6c69c9f5-b507-4e77-92b7-a11d9f72f172 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:32.806407 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6c69c9f5-b507-4e77-92b7-a11d9f72f172 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:32.807727 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6c69c9f5-b507-4e77-92b7-a11d9f72f172 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:32.808453 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6c69c9f5-b507-4e77-92b7-a11d9f72f172 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:32.933548 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-ff4e4796-e064-4840-8c93-035ad6d1031f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:32.947160 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-ff4e4796-e064-4840-8c93-035ad6d1031f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:32.949394 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-ff4e4796-e064-4840-8c93-035ad6d1031f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:32.951107 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ff4e4796-e064-4840-8c93-035ad6d1031f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1739 microversion: 2.20 time: 0.608234 Jan 28 00:54:32.964921 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 200/423] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:32 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1739 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:32.966507 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-6c69c9f5-b507-4e77-92b7-a11d9f72f172 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 32634 microversion: 2.1 time: 0.205220 Jan 28 00:54:32.968868 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 224/424] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:32 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 32634 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:33.374544 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-578d3e2e-b77e-4d1f-93c7-8c0f7a3feb45 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:33.376856 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-578d3e2e-b77e-4d1f-93c7-8c0f7a3feb45 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:33.404407 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-578d3e2e-b77e-4d1f-93c7-8c0f7a3feb45 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:33.404883 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-578d3e2e-b77e-4d1f-93c7-8c0f7a3feb45 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:33.418442 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-578d3e2e-b77e-4d1f-93c7-8c0f7a3feb45 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:33.423452 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-578d3e2e-b77e-4d1f-93c7-8c0f7a3feb45 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:33.558727 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f38eff4f-c3e4-4145-8bc1-d11441a87cca tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:33.564111 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f38eff4f-c3e4-4145-8bc1-d11441a87cca tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:33.596774 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f38eff4f-c3e4-4145-8bc1-d11441a87cca tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:33.614951 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f38eff4f-c3e4-4145-8bc1-d11441a87cca tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:33.620543 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f38eff4f-c3e4-4145-8bc1-d11441a87cca tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:33.621344 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f38eff4f-c3e4-4145-8bc1-d11441a87cca tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:33.713494 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f38eff4f-c3e4-4145-8bc1-d11441a87cca tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Going to try to terminate instance {{(pid=127862) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 00:54:33.915805 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-578d3e2e-b77e-4d1f-93c7-8c0f7a3feb45 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:33.936615 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-578d3e2e-b77e-4d1f-93c7-8c0f7a3feb45 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1567 microversion: 2.1 time: 0.568988 Jan 28 00:54:33.945620 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 201/425] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:33 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1567 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:33.960892 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3b4314bd-c963-46d3-995e-b86de0a5e600 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:33.963021 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-3b4314bd-c963-46d3-995e-b86de0a5e600 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:33.998494 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3b4314bd-c963-46d3-995e-b86de0a5e600 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:33.998494 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3b4314bd-c963-46d3-995e-b86de0a5e600 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:33.998990 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3b4314bd-c963-46d3-995e-b86de0a5e600 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:33.999333 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3b4314bd-c963-46d3-995e-b86de0a5e600 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:34.121885 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f38eff4f-c3e4-4145-8bc1-d11441a87cca tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 204 len: 0 microversion: 2.1 time: 0.579278 Jan 28 00:54:34.124655 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 225/426] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 00:54:33 2022] DELETE /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 00:54:34.137794 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-8bea5c4e-f0fd-4e81-96b2-30bc7e5aee9a req-f7cc6b47-5b4e-4c17-859b-d389c55ba674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76e5f89a-038f-425a-b008-62c40c04e4ee", "tag": "0198106c-9759-4527-a8ac-7d224d22beb2"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:34.142706 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:54:34.142706 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:54:34.158350 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-8bea5c4e-f0fd-4e81-96b2-30bc7e5aee9a req-f7cc6b47-5b4e-4c17-859b-d389c55ba674 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:34.159481 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-8bea5c4e-f0fd-4e81-96b2-30bc7e5aee9a req-f7cc6b47-5b4e-4c17-859b-d389c55ba674 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:34.179988 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-8bea5c4e-f0fd-4e81-96b2-30bc7e5aee9a req-f7cc6b47-5b4e-4c17-859b-d389c55ba674 service nova] Creating event network-changed:0198106c-9759-4527-a8ac-7d224d22beb2 for instance 76e5f89a-038f-425a-b008-62c40c04e4ee on hv-cinder-80952 Jan 28 00:54:34.191529 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-8bea5c4e-f0fd-4e81-96b2-30bc7e5aee9a req-f7cc6b47-5b4e-4c17-859b-d389c55ba674 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062909 Jan 28 00:54:34.193009 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 226/427] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:54:34.203476 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-e9c3cc73-4a5f-4725-932f-613d2b1a2271 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:34.205541 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-e9c3cc73-4a5f-4725-932f-613d2b1a2271 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:34.218305 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e9c3cc73-4a5f-4725-932f-613d2b1a2271 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:34.220203 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e9c3cc73-4a5f-4725-932f-613d2b1a2271 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:34.221854 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e9c3cc73-4a5f-4725-932f-613d2b1a2271 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:34.222890 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e9c3cc73-4a5f-4725-932f-613d2b1a2271 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:34.668677 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-3b4314bd-c963-46d3-995e-b86de0a5e600 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:34.681736 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3b4314bd-c963-46d3-995e-b86de0a5e600 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 200 len: 1318 microversion: 2.1 time: 0.732498 Jan 28 00:54:34.684044 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 202/428] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:33 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 1318 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:34.694326 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-8eb67107-8b9e-49ab-a437-c6e6f5d7a7a6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:34.697254 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-8eb67107-8b9e-49ab-a437-c6e6f5d7a7a6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:34.715312 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-e9c3cc73-4a5f-4725-932f-613d2b1a2271 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:34.745981 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-e9c3cc73-4a5f-4725-932f-613d2b1a2271 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:34.757968 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8eb67107-8b9e-49ab-a437-c6e6f5d7a7a6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:34.759313 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8eb67107-8b9e-49ab-a437-c6e6f5d7a7a6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:34.760188 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-e9c3cc73-4a5f-4725-932f-613d2b1a2271 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:34.761898 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8eb67107-8b9e-49ab-a437-c6e6f5d7a7a6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:34.762939 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8eb67107-8b9e-49ab-a437-c6e6f5d7a7a6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:34.777756 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-e9c3cc73-4a5f-4725-932f-613d2b1a2271 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1739 microversion: 2.20 time: 0.567546 Jan 28 00:54:34.777756 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 227/429] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:34 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1739 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:34.806448 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-e67f8032-8e69-4565-9404-1f7e1431f107 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:34.811012 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-e67f8032-8e69-4565-9404-1f7e1431f107 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:34.860386 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e67f8032-8e69-4565-9404-1f7e1431f107 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:34.861374 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e67f8032-8e69-4565-9404-1f7e1431f107 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:34.863505 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e67f8032-8e69-4565-9404-1f7e1431f107 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:34.870847 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e67f8032-8e69-4565-9404-1f7e1431f107 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:34.974542 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-8eb67107-8b9e-49ab-a437-c6e6f5d7a7a6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 33897 microversion: 2.1 time: 0.288453 Jan 28 00:54:34.977408 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 203/430] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:34 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 33897 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:34.991675 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d8c7c270-12dc-4749-b9e8-d33203732158 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:34.992423 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d8c7c270-12dc-4749-b9e8-d33203732158 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:35.003332 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d8c7c270-12dc-4749-b9e8-d33203732158 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:35.003842 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d8c7c270-12dc-4749-b9e8-d33203732158 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:35.005817 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d8c7c270-12dc-4749-b9e8-d33203732158 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:35.006120 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d8c7c270-12dc-4749-b9e8-d33203732158 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:35.309619 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-e67f8032-8e69-4565-9404-1f7e1431f107 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:35.321974 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-e67f8032-8e69-4565-9404-1f7e1431f107 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1502 microversion: 2.1 time: 0.543954 Jan 28 00:54:35.324125 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 228/431] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:34 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1502 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:35.348254 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d7d9bce1-c6b1-45ed-b6f3-0d38f21caee1 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1817245407", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2038861869", "security_groups": [{"name": "tempest-secgroup-smoke-726777567"}], "block_device_mapping_v2": [{"uuid": "2bea1953-5792-42c0-8f47-2163687f562f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "30aa1d90-fbc0-4d47-a9cd-dbadcfadc4e7"}]}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:35.428384 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d8c7c270-12dc-4749-b9e8-d33203732158 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:35.465397 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d8c7c270-12dc-4749-b9e8-d33203732158 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1567 microversion: 2.1 time: 0.487091 Jan 28 00:54:35.467503 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 204/432] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:34 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1567 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:35.637621 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.network.neutron [None req-d7d9bce1-c6b1-45ed-b6f3-0d38f21caee1 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] validate_networks() for [('30aa1d90-fbc0-4d47-a9cd-dbadcfadc4e7', None, None, None, None, None)] {{(pid=127862) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:54:35.716258 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4fc2dd16-dc19-4f1c-b21b-7d30fc892fdb tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:35.720358 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4fc2dd16-dc19-4f1c-b21b-7d30fc892fdb tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:35.738389 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4fc2dd16-dc19-4f1c-b21b-7d30fc892fdb tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:35.741242 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4fc2dd16-dc19-4f1c-b21b-7d30fc892fdb tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:35.742426 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4fc2dd16-dc19-4f1c-b21b-7d30fc892fdb tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:35.743704 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4fc2dd16-dc19-4f1c-b21b-7d30fc892fdb tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:36.102363 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4fc2dd16-dc19-4f1c-b21b-7d30fc892fdb tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:36.116594 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4fc2dd16-dc19-4f1c-b21b-7d30fc892fdb tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 200 len: 1318 microversion: 2.1 time: 0.408950 Jan 28 00:54:36.116594 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 205/433] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:35 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:54:36.145748 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7c18bcd6-3fa5-4f00-b097-9c62e17e6b26 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:36.152649 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7c18bcd6-3fa5-4f00-b097-9c62e17e6b26 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:36.199801 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7c18bcd6-3fa5-4f00-b097-9c62e17e6b26 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:36.201055 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7c18bcd6-3fa5-4f00-b097-9c62e17e6b26 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:36.211639 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7c18bcd6-3fa5-4f00-b097-9c62e17e6b26 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:36.211639 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7c18bcd6-3fa5-4f00-b097-9c62e17e6b26 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:36.547592 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7c18bcd6-3fa5-4f00-b097-9c62e17e6b26 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:36.558733 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7c18bcd6-3fa5-4f00-b097-9c62e17e6b26 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:36.567476 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7c18bcd6-3fa5-4f00-b097-9c62e17e6b26 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:36.571772 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7c18bcd6-3fa5-4f00-b097-9c62e17e6b26 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1739 microversion: 2.20 time: 0.439648 Jan 28 00:54:36.576369 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 206/434] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:36 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1739 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:36.597105 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b78c3c39-8049-4a6c-9f8c-fb7a47cd3a6e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:36.602984 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b78c3c39-8049-4a6c-9f8c-fb7a47cd3a6e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:36.629096 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b78c3c39-8049-4a6c-9f8c-fb7a47cd3a6e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:36.630397 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b78c3c39-8049-4a6c-9f8c-fb7a47cd3a6e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:36.632577 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b78c3c39-8049-4a6c-9f8c-fb7a47cd3a6e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:36.636721 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b78c3c39-8049-4a6c-9f8c-fb7a47cd3a6e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:36.721902 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-d7d9bce1-c6b1-45ed-b6f3-0d38f21caee1 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Flavor limits 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:54:36.723664 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-d7d9bce1-c6b1-45ed-b6f3-0d38f21caee1 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Image limits 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:54:36.724933 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-d7d9bce1-c6b1-45ed-b6f3-0d38f21caee1 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Flavor pref 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:54:36.726077 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-d7d9bce1-c6b1-45ed-b6f3-0d38f21caee1 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Image pref 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:54:36.726993 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-d7d9bce1-c6b1-45ed-b6f3-0d38f21caee1 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:54:36.758575 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d7d9bce1-c6b1-45ed-b6f3-0d38f21caee1 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:36.759579 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d7d9bce1-c6b1-45ed-b6f3-0d38f21caee1 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:36.761141 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d7d9bce1-c6b1-45ed-b6f3-0d38f21caee1 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:36.762287 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d7d9bce1-c6b1-45ed-b6f3-0d38f21caee1 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:36.815718 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-d7d9bce1-c6b1-45ed-b6f3-0d38f21caee1 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Getting quotas for project dfca2fc1b6c24ac7910c44e6d7936366. Resources: {'instances', 'cores', 'ram'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:54:36.825422 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b78c3c39-8049-4a6c-9f8c-fb7a47cd3a6e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 35069 microversion: 2.1 time: 0.239115 Jan 28 00:54:36.833311 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-d7d9bce1-c6b1-45ed-b6f3-0d38f21caee1 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Getting quotas for user 4a973914214249bebd8bd067a8c21ac3 and project dfca2fc1b6c24ac7910c44e6d7936366. Resources: {'instances', 'cores', 'ram'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:54:36.835686 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 207/435] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:36 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 35069 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:36.847921 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3bb9a57f-4ae6-43a4-8819-65ef9b258682 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:36.849899 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-3bb9a57f-4ae6-43a4-8819-65ef9b258682 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:36.868370 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3bb9a57f-4ae6-43a4-8819-65ef9b258682 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:36.869428 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3bb9a57f-4ae6-43a4-8819-65ef9b258682 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:36.871075 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3bb9a57f-4ae6-43a4-8819-65ef9b258682 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:36.872371 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3bb9a57f-4ae6-43a4-8819-65ef9b258682 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:37.016922 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d7d9bce1-c6b1-45ed-b6f3-0d38f21caee1 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Going to run 1 instances... {{(pid=127862) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:54:37.021652 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d7d9bce1-c6b1-45ed-b6f3-0d38f21caee1 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2bea1953-5792-42c0-8f47-2163687f562f',volume_size=None,volume_type=None)] {{(pid=127862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:54:37.199014 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-3bb9a57f-4ae6-43a4-8819-65ef9b258682 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:37.214355 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3bb9a57f-4ae6-43a4-8819-65ef9b258682 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1502 microversion: 2.1 time: 0.376233 Jan 28 00:54:37.216518 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 208/436] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:36 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1502 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:37.225396 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0072e1e6-6593-4da3-a931-d3f8b05860ab tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:37.226646 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0072e1e6-6593-4da3-a931-d3f8b05860ab tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:37.242281 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0072e1e6-6593-4da3-a931-d3f8b05860ab tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:37.245462 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0072e1e6-6593-4da3-a931-d3f8b05860ab tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:37.250959 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0072e1e6-6593-4da3-a931-d3f8b05860ab tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:37.252483 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0072e1e6-6593-4da3-a931-d3f8b05860ab tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:37.397900 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d7d9bce1-c6b1-45ed-b6f3-0d38f21caee1 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.071176 Jan 28 00:54:37.423949 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 229/437] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 00:54:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 2099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 00:54:37.448582 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-e0a40511-7311-4d9e-8db8-43a972b1cd4d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:37.449681 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-e0a40511-7311-4d9e-8db8-43a972b1cd4d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:37.490855 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e0a40511-7311-4d9e-8db8-43a972b1cd4d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:37.491692 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e0a40511-7311-4d9e-8db8-43a972b1cd4d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:37.493498 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e0a40511-7311-4d9e-8db8-43a972b1cd4d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:37.498637 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e0a40511-7311-4d9e-8db8-43a972b1cd4d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:37.883227 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-0072e1e6-6593-4da3-a931-d3f8b05860ab tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:37.906094 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0072e1e6-6593-4da3-a931-d3f8b05860ab tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1567 microversion: 2.1 time: 0.686427 Jan 28 00:54:37.922647 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 209/438] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:37 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1567 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:37.925616 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-472b1481-16d5-4b79-b610-fa044e686aae tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:37.930663 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-472b1481-16d5-4b79-b610-fa044e686aae tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:38.195328 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-472b1481-16d5-4b79-b610-fa044e686aae tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:38.209747 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-472b1481-16d5-4b79-b610-fa044e686aae tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1095 microversion: 2.1 time: 0.296921 Jan 28 00:54:38.227897 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 210/439] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:37 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1095 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:38.240198 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-50bd917b-793c-4c67-8c5c-9885ad22dfa1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:38.240198 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-50bd917b-793c-4c67-8c5c-9885ad22dfa1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:38.259007 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-50bd917b-793c-4c67-8c5c-9885ad22dfa1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:38.261562 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-50bd917b-793c-4c67-8c5c-9885ad22dfa1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:38.272677 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-50bd917b-793c-4c67-8c5c-9885ad22dfa1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:38.273266 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-50bd917b-793c-4c67-8c5c-9885ad22dfa1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:38.458550 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-e0a40511-7311-4d9e-8db8-43a972b1cd4d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:38.509611 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-e0a40511-7311-4d9e-8db8-43a972b1cd4d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 200 len: 1318 microversion: 2.1 time: 1.083011 Jan 28 00:54:38.514814 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 230/440] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:37 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 1318 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:38.561333 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9998607c-cf20-489f-933f-1016eac3d477 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:38.582318 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9998607c-cf20-489f-933f-1016eac3d477 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:38.615091 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9998607c-cf20-489f-933f-1016eac3d477 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:38.617582 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9998607c-cf20-489f-933f-1016eac3d477 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:38.628084 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9998607c-cf20-489f-933f-1016eac3d477 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:38.629479 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9998607c-cf20-489f-933f-1016eac3d477 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:38.868916 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9998607c-cf20-489f-933f-1016eac3d477 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 37121 microversion: 2.1 time: 0.349450 Jan 28 00:54:38.880065 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 231/441] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:38 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 37121 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:38.938687 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3c735d41-adf4-40a7-8714-135831004493 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:38.942835 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3c735d41-adf4-40a7-8714-135831004493 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:38.960644 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3c735d41-adf4-40a7-8714-135831004493 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:38.962555 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3c735d41-adf4-40a7-8714-135831004493 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:38.963644 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3c735d41-adf4-40a7-8714-135831004493 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:38.966901 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3c735d41-adf4-40a7-8714-135831004493 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:39.148078 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3c735d41-adf4-40a7-8714-135831004493 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:39.150097 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3c735d41-adf4-40a7-8714-135831004493 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:39.153494 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.objects.instance [None req-3c735d41-adf4-40a7-8714-135831004493 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lazy-loading 'fault' on Instance uuid c22805ca-a78b-4f35-89cc-7a4d89369afe {{(pid=127862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:54:39.369341 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3c735d41-adf4-40a7-8714-135831004493 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a854f3323e4970be40d712bda617c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731aa66b74a3493ca730bcd22915d385', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:39.386457 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-50bd917b-793c-4c67-8c5c-9885ad22dfa1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:39.428511 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-50bd917b-793c-4c67-8c5c-9885ad22dfa1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:39.435537 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3c735d41-adf4-40a7-8714-135831004493 tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 200 len: 1303 microversion: 2.1 time: 0.535428 Jan 28 00:54:39.436677 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 232/442] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:38 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 1303 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:39.443636 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-50bd917b-793c-4c67-8c5c-9885ad22dfa1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:39.449637 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-50bd917b-793c-4c67-8c5c-9885ad22dfa1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1739 microversion: 2.20 time: 1.219050 Jan 28 00:54:39.454457 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 211/443] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:38 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1739 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:39.456514 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-f0d8dd90-dffe-4b7e-ae87-7ea15fc3ff44 req-a5b98d38-d6f1-4f4c-8788-8c3c56d1f6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c22805ca-a78b-4f35-89cc-7a4d89369afe", "name": "network-vif-deleted", "tag": "f21093fa-e21d-479a-a997-8e4c79bb4778"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:39.460507 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:54:39.460507 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:54:39.473864 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d2a3ad4a-9941-403f-923e-efe7bb3a8116 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:39.485968 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d2a3ad4a-9941-403f-923e-efe7bb3a8116 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:39.502505 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-f0d8dd90-dffe-4b7e-ae87-7ea15fc3ff44 req-a5b98d38-d6f1-4f4c-8788-8c3c56d1f6e6 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:39.503415 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-f0d8dd90-dffe-4b7e-ae87-7ea15fc3ff44 req-a5b98d38-d6f1-4f4c-8788-8c3c56d1f6e6 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:39.510607 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d2a3ad4a-9941-403f-923e-efe7bb3a8116 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:39.512418 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d2a3ad4a-9941-403f-923e-efe7bb3a8116 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:39.514076 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d2a3ad4a-9941-403f-923e-efe7bb3a8116 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:39.515393 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d2a3ad4a-9941-403f-923e-efe7bb3a8116 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:39.548373 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-f0d8dd90-dffe-4b7e-ae87-7ea15fc3ff44 req-a5b98d38-d6f1-4f4c-8788-8c3c56d1f6e6 service nova] Creating event network-vif-deleted:f21093fa-e21d-479a-a997-8e4c79bb4778 for instance c22805ca-a78b-4f35-89cc-7a4d89369afe on hv-cinder-80952 Jan 28 00:54:39.592492 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-f0d8dd90-dffe-4b7e-ae87-7ea15fc3ff44 req-a5b98d38-d6f1-4f4c-8788-8c3c56d1f6e6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128231 Jan 28 00:54:39.594149 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 233/444] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:54:39.634785 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1b247ca1-cd89-440d-a407-eea70a88f874 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:39.641516 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1b247ca1-cd89-440d-a407-eea70a88f874 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:39.662582 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1b247ca1-cd89-440d-a407-eea70a88f874 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:39.663448 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1b247ca1-cd89-440d-a407-eea70a88f874 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:39.673368 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1b247ca1-cd89-440d-a407-eea70a88f874 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:39.674278 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1b247ca1-cd89-440d-a407-eea70a88f874 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:40.749085 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-1b247ca1-cd89-440d-a407-eea70a88f874 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:40.775029 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1b247ca1-cd89-440d-a407-eea70a88f874 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1193 microversion: 2.1 time: 1.170099 Jan 28 00:54:40.780091 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 234/445] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:39 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1193 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:40.811801 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-94c25a18-d76c-4768-9848-d40c22b00b00 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:40.813631 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-94c25a18-d76c-4768-9848-d40c22b00b00 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:40.834011 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-94c25a18-d76c-4768-9848-d40c22b00b00 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:40.835237 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-94c25a18-d76c-4768-9848-d40c22b00b00 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:40.837096 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-94c25a18-d76c-4768-9848-d40c22b00b00 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:40.840454 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-94c25a18-d76c-4768-9848-d40c22b00b00 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:41.103159 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d2a3ad4a-9941-403f-923e-efe7bb3a8116 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:41.118230 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d2a3ad4a-9941-403f-923e-efe7bb3a8116 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1567 microversion: 2.1 time: 1.660553 Jan 28 00:54:41.125732 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 212/446] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:39 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1567 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:41.139144 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-15f911b0-6bba-4f84-8408-32c3dd90f593 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:41.145301 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-15f911b0-6bba-4f84-8408-32c3dd90f593 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:41.161927 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-15f911b0-6bba-4f84-8408-32c3dd90f593 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:41.163692 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-15f911b0-6bba-4f84-8408-32c3dd90f593 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:41.166547 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-15f911b0-6bba-4f84-8408-32c3dd90f593 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:41.167381 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-15f911b0-6bba-4f84-8408-32c3dd90f593 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:41.323541 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-15f911b0-6bba-4f84-8408-32c3dd90f593 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 38138 microversion: 2.1 time: 0.195850 Jan 28 00:54:41.324422 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 213/447] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:41 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 38138 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:41.334602 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-71e0a05a-351f-4799-a5e3-2c7eba4a223e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:41.346079 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-71e0a05a-351f-4799-a5e3-2c7eba4a223e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] [instance: c22805ca-a78b-4f35-89cc-7a4d89369afe] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:41.362555 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-71e0a05a-351f-4799-a5e3-2c7eba4a223e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:41.369395 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-71e0a05a-351f-4799-a5e3-2c7eba4a223e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:41.372925 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-71e0a05a-351f-4799-a5e3-2c7eba4a223e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:41.374088 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-71e0a05a-351f-4799-a5e3-2c7eba4a223e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:41.423227 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-71e0a05a-351f-4799-a5e3-2c7eba4a223e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] HTTP exception thrown: Instance c22805ca-a78b-4f35-89cc-7a4d89369afe could not be found. Jan 28 00:54:41.423870 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-71e0a05a-351f-4799-a5e3-2c7eba4a223e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] Returning 404 to user: Instance c22805ca-a78b-4f35-89cc-7a4d89369afe could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:54:41.431913 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-71e0a05a-351f-4799-a5e3-2c7eba4a223e tempest-VolumesActionsTest-2124719184 tempest-VolumesActionsTest-2124719184-project] 10.222.0.25 "GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe" status: 404 len: 111 microversion: 2.1 time: 0.106111 Jan 28 00:54:41.435835 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 214/448] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:41 2022] GET /compute/v2.1/servers/c22805ca-a78b-4f35-89cc-7a4d89369afe => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:54:41.453549 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-93f23a76-30db-40f5-a0b0-8cb0586eed03 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:41.454404 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-93f23a76-30db-40f5-a0b0-8cb0586eed03 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:41.478529 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-93f23a76-30db-40f5-a0b0-8cb0586eed03 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:41.479222 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-93f23a76-30db-40f5-a0b0-8cb0586eed03 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:41.480915 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-93f23a76-30db-40f5-a0b0-8cb0586eed03 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:41.481203 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-93f23a76-30db-40f5-a0b0-8cb0586eed03 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:41.498442 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-94c25a18-d76c-4768-9848-d40c22b00b00 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:41.551689 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-94c25a18-d76c-4768-9848-d40c22b00b00 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 200 len: 1318 microversion: 2.1 time: 0.768095 Jan 28 00:54:41.567833 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 235/449] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:40 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 1318 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:41.811925 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-0025d965-3599-4f7a-afbd-71a67b988041 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:41.817087 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-0025d965-3599-4f7a-afbd-71a67b988041 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:41.875098 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0025d965-3599-4f7a-afbd-71a67b988041 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:41.876560 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0025d965-3599-4f7a-afbd-71a67b988041 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:41.877984 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0025d965-3599-4f7a-afbd-71a67b988041 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:41.878753 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0025d965-3599-4f7a-afbd-71a67b988041 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:42.176652 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-0025d965-3599-4f7a-afbd-71a67b988041 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:42.211648 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-0025d965-3599-4f7a-afbd-71a67b988041 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1199 microversion: 2.1 time: 0.399123 Jan 28 00:54:42.214168 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 236/450] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:41 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1199 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:42.234042 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1d5d609b-fe6c-466e-83ad-2d0e8234bb63 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:42.235550 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1d5d609b-fe6c-466e-83ad-2d0e8234bb63 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:42.262426 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1d5d609b-fe6c-466e-83ad-2d0e8234bb63 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:42.263240 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1d5d609b-fe6c-466e-83ad-2d0e8234bb63 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:42.264836 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1d5d609b-fe6c-466e-83ad-2d0e8234bb63 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:42.266839 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1d5d609b-fe6c-466e-83ad-2d0e8234bb63 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:42.323894 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-93f23a76-30db-40f5-a0b0-8cb0586eed03 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:42.344877 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-93f23a76-30db-40f5-a0b0-8cb0586eed03 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:42.355202 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-93f23a76-30db-40f5-a0b0-8cb0586eed03 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:42.356856 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-93f23a76-30db-40f5-a0b0-8cb0586eed03 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1739 microversion: 2.20 time: 0.917019 Jan 28 00:54:42.368782 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 215/451] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:41 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1739 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:42.391147 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3442aa1a-7f6b-4118-9437-3c7e62ef6860 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:42.397733 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-3442aa1a-7f6b-4118-9437-3c7e62ef6860 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:42.412159 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3442aa1a-7f6b-4118-9437-3c7e62ef6860 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:42.417321 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3442aa1a-7f6b-4118-9437-3c7e62ef6860 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:42.418991 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3442aa1a-7f6b-4118-9437-3c7e62ef6860 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:42.420135 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3442aa1a-7f6b-4118-9437-3c7e62ef6860 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:42.551175 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3442aa1a-7f6b-4118-9437-3c7e62ef6860 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 38138 microversion: 2.1 time: 0.169476 Jan 28 00:54:42.552353 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 216/452] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:42 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 38138 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:42.584659 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3a8e70b9-843f-4187-99a7-5fd0791f6d9d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:42.585765 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-3a8e70b9-843f-4187-99a7-5fd0791f6d9d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:42.604770 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3a8e70b9-843f-4187-99a7-5fd0791f6d9d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:42.605701 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3a8e70b9-843f-4187-99a7-5fd0791f6d9d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:42.611941 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3a8e70b9-843f-4187-99a7-5fd0791f6d9d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:42.613385 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3a8e70b9-843f-4187-99a7-5fd0791f6d9d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:43.406606 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-1d5d609b-fe6c-466e-83ad-2d0e8234bb63 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:43.454998 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1d5d609b-fe6c-466e-83ad-2d0e8234bb63 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1567 microversion: 2.1 time: 1.237050 Jan 28 00:54:43.456052 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 237/453] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:42 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1567 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:43.523931 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-c0ead89a-5101-48f0-81a1-273c91153858 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:43.525241 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-c0ead89a-5101-48f0-81a1-273c91153858 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:43.556825 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c0ead89a-5101-48f0-81a1-273c91153858 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:43.557675 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c0ead89a-5101-48f0-81a1-273c91153858 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:43.560296 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c0ead89a-5101-48f0-81a1-273c91153858 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:43.567298 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c0ead89a-5101-48f0-81a1-273c91153858 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:43.657148 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-3a8e70b9-843f-4187-99a7-5fd0791f6d9d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:43.669471 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3a8e70b9-843f-4187-99a7-5fd0791f6d9d tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 200 len: 1318 microversion: 2.1 time: 1.102698 Jan 28 00:54:43.680000 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 217/454] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:42 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 1318 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:43.712166 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2e6b6b03-f4ae-4fd2-bd5d-dfe0dc469292 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:43.720567 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2e6b6b03-f4ae-4fd2-bd5d-dfe0dc469292 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:43.756463 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2e6b6b03-f4ae-4fd2-bd5d-dfe0dc469292 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:43.757377 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2e6b6b03-f4ae-4fd2-bd5d-dfe0dc469292 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:43.762262 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2e6b6b03-f4ae-4fd2-bd5d-dfe0dc469292 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:43.765218 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2e6b6b03-f4ae-4fd2-bd5d-dfe0dc469292 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:43.935513 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c0ead89a-5101-48f0-81a1-273c91153858 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:43.980392 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-c0ead89a-5101-48f0-81a1-273c91153858 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1199 microversion: 2.1 time: 0.498921 Jan 28 00:54:43.982400 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 238/455] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:43 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1199 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:43.998897 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-9ee91c85-0e91-43e5-9243-d1ba938e5aa7 req-9e09a01e-bad0-46de-8378-6e15b462bb3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76e5f89a-038f-425a-b008-62c40c04e4ee", "name": "network-vif-plugged", "status": "completed", "tag": "0198106c-9759-4527-a8ac-7d224d22beb2"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:44.004578 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:54:44.004578 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:54:44.030465 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-9ee91c85-0e91-43e5-9243-d1ba938e5aa7 req-9e09a01e-bad0-46de-8378-6e15b462bb3a service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:44.033854 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-9ee91c85-0e91-43e5-9243-d1ba938e5aa7 req-9e09a01e-bad0-46de-8378-6e15b462bb3a service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:44.079834 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-9ee91c85-0e91-43e5-9243-d1ba938e5aa7 req-9e09a01e-bad0-46de-8378-6e15b462bb3a service nova] Creating event network-vif-plugged:0198106c-9759-4527-a8ac-7d224d22beb2 for instance 76e5f89a-038f-425a-b008-62c40c04e4ee on hv-cinder-80952 Jan 28 00:54:44.086531 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-9ee91c85-0e91-43e5-9243-d1ba938e5aa7 req-9e09a01e-bad0-46de-8378-6e15b462bb3a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102262 Jan 28 00:54:44.088154 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 239/456] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:54:44.094280 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f7b8de68-a9fd-498f-ae58-082e5c8ff476 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:44.095900 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f7b8de68-a9fd-498f-ae58-082e5c8ff476 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:44.103101 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f7b8de68-a9fd-498f-ae58-082e5c8ff476 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:44.103946 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f7b8de68-a9fd-498f-ae58-082e5c8ff476 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:44.105193 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f7b8de68-a9fd-498f-ae58-082e5c8ff476 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:44.105904 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f7b8de68-a9fd-498f-ae58-082e5c8ff476 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:44.333574 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f7b8de68-a9fd-498f-ae58-082e5c8ff476 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 200 len: 38269 microversion: 2.1 time: 0.243153 Jan 28 00:54:44.336199 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 240/457] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:44 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 38269 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:54:44.369391 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-b4771718-4581-4bba-bbf1-290cc0b048c4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:44.371389 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-b4771718-4581-4bba-bbf1-290cc0b048c4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:44.395871 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b4771718-4581-4bba-bbf1-290cc0b048c4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:44.397751 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b4771718-4581-4bba-bbf1-290cc0b048c4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:44.410940 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b4771718-4581-4bba-bbf1-290cc0b048c4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:44.417850 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b4771718-4581-4bba-bbf1-290cc0b048c4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:44.518673 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-b4771718-4581-4bba-bbf1-290cc0b048c4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/ips" status: 200 len: 146 microversion: 2.1 time: 0.167143 Jan 28 00:54:44.531964 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 241/458] 10.222.0.25 () {58 vars in 1247 bytes} [Fri Jan 28 00:54:44 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/ips => generated 146 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:54:44.556335 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-637fc834-cf46-4f66-aa87-ff3ea59c33a3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:44.557460 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-637fc834-cf46-4f66-aa87-ff3ea59c33a3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:44.582483 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-637fc834-cf46-4f66-aa87-ff3ea59c33a3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:44.587382 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-637fc834-cf46-4f66-aa87-ff3ea59c33a3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:44.589072 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-637fc834-cf46-4f66-aa87-ff3ea59c33a3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:44.592501 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-637fc834-cf46-4f66-aa87-ff3ea59c33a3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:44.999400 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-2e6b6b03-f4ae-4fd2-bd5d-dfe0dc469292 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:45.016345 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-2e6b6b03-f4ae-4fd2-bd5d-dfe0dc469292 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:45.017943 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-2e6b6b03-f4ae-4fd2-bd5d-dfe0dc469292 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:45.019177 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2e6b6b03-f4ae-4fd2-bd5d-dfe0dc469292 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1739 microversion: 2.20 time: 1.335365 Jan 28 00:54:45.019785 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 218/459] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:43 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1739 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:45.033840 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0b2bf2a9-9017-4ebe-9cf9-a256e055373b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:45.038925 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0b2bf2a9-9017-4ebe-9cf9-a256e055373b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:45.117857 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0b2bf2a9-9017-4ebe-9cf9-a256e055373b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:45.119127 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0b2bf2a9-9017-4ebe-9cf9-a256e055373b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:45.121304 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0b2bf2a9-9017-4ebe-9cf9-a256e055373b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:45.126433 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0b2bf2a9-9017-4ebe-9cf9-a256e055373b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:45.532061 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-637fc834-cf46-4f66-aa87-ff3ea59c33a3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:45.561183 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-637fc834-cf46-4f66-aa87-ff3ea59c33a3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1567 microversion: 2.1 time: 1.023790 Jan 28 00:54:45.562396 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 242/460] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:44 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1567 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:45.576809 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-5a04ae6a-f193-4ac6-a8a8-7bbd84d7ffb0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:45.578375 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-5a04ae6a-f193-4ac6-a8a8-7bbd84d7ffb0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:45.622273 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5a04ae6a-f193-4ac6-a8a8-7bbd84d7ffb0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:45.623451 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5a04ae6a-f193-4ac6-a8a8-7bbd84d7ffb0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:45.625097 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5a04ae6a-f193-4ac6-a8a8-7bbd84d7ffb0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:45.626082 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5a04ae6a-f193-4ac6-a8a8-7bbd84d7ffb0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:45.897730 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-0b2bf2a9-9017-4ebe-9cf9-a256e055373b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:45.912651 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0b2bf2a9-9017-4ebe-9cf9-a256e055373b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 200 len: 1318 microversion: 2.1 time: 0.889851 Jan 28 00:54:45.920355 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 219/461] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:45 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 1318 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:46.042068 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ae38072f-6b03-4fda-a535-98aa05e8c09f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:46.043072 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ae38072f-6b03-4fda-a535-98aa05e8c09f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:46.050115 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ae38072f-6b03-4fda-a535-98aa05e8c09f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:46.050563 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ae38072f-6b03-4fda-a535-98aa05e8c09f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:46.051587 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ae38072f-6b03-4fda-a535-98aa05e8c09f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:46.052209 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ae38072f-6b03-4fda-a535-98aa05e8c09f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:46.089207 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-5a04ae6a-f193-4ac6-a8a8-7bbd84d7ffb0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:46.106460 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-5a04ae6a-f193-4ac6-a8a8-7bbd84d7ffb0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1266 microversion: 2.1 time: 0.536221 Jan 28 00:54:46.127526 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 243/462] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:45 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1266 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:46.503656 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-ae38072f-6b03-4fda-a535-98aa05e8c09f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:46.528497 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-ae38072f-6b03-4fda-a535-98aa05e8c09f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:46.537576 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-ae38072f-6b03-4fda-a535-98aa05e8c09f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:46.540726 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ae38072f-6b03-4fda-a535-98aa05e8c09f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1739 microversion: 2.20 time: 0.502857 Jan 28 00:54:46.549871 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 220/463] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:46 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1739 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:54:46.598524 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f01aac87-f789-4126-9c3a-0a8569cfeb0b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:46.602015 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f01aac87-f789-4126-9c3a-0a8569cfeb0b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:46.618905 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f01aac87-f789-4126-9c3a-0a8569cfeb0b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:46.620331 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f01aac87-f789-4126-9c3a-0a8569cfeb0b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:46.623041 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f01aac87-f789-4126-9c3a-0a8569cfeb0b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:46.627629 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f01aac87-f789-4126-9c3a-0a8569cfeb0b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:46.952228 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c826a595-bfd0-4118-bf38-8d76cc366696 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:46.955903 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c826a595-bfd0-4118-bf38-8d76cc366696 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:46.993789 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c826a595-bfd0-4118-bf38-8d76cc366696 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:46.995094 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c826a595-bfd0-4118-bf38-8d76cc366696 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:47.000931 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c826a595-bfd0-4118-bf38-8d76cc366696 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:47.002298 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c826a595-bfd0-4118-bf38-8d76cc366696 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:47.132148 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f01aac87-f789-4126-9c3a-0a8569cfeb0b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:47.168327 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f01aac87-f789-4126-9c3a-0a8569cfeb0b tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1567 microversion: 2.1 time: 0.561504 Jan 28 00:54:47.184772 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 244/464] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:46 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1567 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:47.198944 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-0c7346b2-3afa-4259-a9ae-5649c2f6b3f3 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:47.200573 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-0c7346b2-3afa-4259-a9ae-5649c2f6b3f3 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:47.216962 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0c7346b2-3afa-4259-a9ae-5649c2f6b3f3 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:47.218993 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0c7346b2-3afa-4259-a9ae-5649c2f6b3f3 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:47.221390 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0c7346b2-3afa-4259-a9ae-5649c2f6b3f3 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:47.222518 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0c7346b2-3afa-4259-a9ae-5649c2f6b3f3 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:47.721167 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-c826a595-bfd0-4118-bf38-8d76cc366696 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:47.747839 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c826a595-bfd0-4118-bf38-8d76cc366696 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 200 len: 1318 microversion: 2.1 time: 0.804019 Jan 28 00:54:47.751323 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 221/465] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:46 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 1318 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:47.781216 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-fc6aa790-3016-435c-a6ba-7e610492e8b2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:47.782942 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-fc6aa790-3016-435c-a6ba-7e610492e8b2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:47.798729 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fc6aa790-3016-435c-a6ba-7e610492e8b2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:47.804489 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fc6aa790-3016-435c-a6ba-7e610492e8b2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:47.814486 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fc6aa790-3016-435c-a6ba-7e610492e8b2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:47.826078 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-0c7346b2-3afa-4259-a9ae-5649c2f6b3f3 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:47.831694 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fc6aa790-3016-435c-a6ba-7e610492e8b2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:47.876503 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-0c7346b2-3afa-4259-a9ae-5649c2f6b3f3 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1266 microversion: 2.1 time: 0.687869 Jan 28 00:54:47.887397 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 245/466] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:47 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1266 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:48.199359 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-22919241-b631-4256-8a73-26394454e2c4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:48.200180 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-22919241-b631-4256-8a73-26394454e2c4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:48.225459 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-22919241-b631-4256-8a73-26394454e2c4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:48.226150 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-22919241-b631-4256-8a73-26394454e2c4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:48.228291 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-22919241-b631-4256-8a73-26394454e2c4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:48.229207 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-22919241-b631-4256-8a73-26394454e2c4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:48.306707 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-fc6aa790-3016-435c-a6ba-7e610492e8b2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:48.321344 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-fc6aa790-3016-435c-a6ba-7e610492e8b2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:48.335814 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-fc6aa790-3016-435c-a6ba-7e610492e8b2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:48.344360 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-fc6aa790-3016-435c-a6ba-7e610492e8b2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1739 microversion: 2.20 time: 0.589129 Jan 28 00:54:48.346685 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 222/467] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:47 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1739 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:48.769896 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0bb6e6db-9fc0-49fc-b393-3b6c49b92303 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:48.770914 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0bb6e6db-9fc0-49fc-b393-3b6c49b92303 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:48.785957 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-22919241-b631-4256-8a73-26394454e2c4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:48.787591 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0bb6e6db-9fc0-49fc-b393-3b6c49b92303 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:48.788361 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0bb6e6db-9fc0-49fc-b393-3b6c49b92303 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:48.795085 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0bb6e6db-9fc0-49fc-b393-3b6c49b92303 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:48.796268 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0bb6e6db-9fc0-49fc-b393-3b6c49b92303 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:48.803159 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-22919241-b631-4256-8a73-26394454e2c4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1567 microversion: 2.1 time: 0.606568 Jan 28 00:54:48.816163 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 246/468] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:48 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1567 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:54:48.918261 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ea47c093-3b0e-4687-9eec-58a847cf46fa tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:48.919886 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ea47c093-3b0e-4687-9eec-58a847cf46fa tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:48.986537 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ea47c093-3b0e-4687-9eec-58a847cf46fa tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:48.996058 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ea47c093-3b0e-4687-9eec-58a847cf46fa tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:49.003970 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ea47c093-3b0e-4687-9eec-58a847cf46fa tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:49.005185 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ea47c093-3b0e-4687-9eec-58a847cf46fa tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:49.508530 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-0bb6e6db-9fc0-49fc-b393-3b6c49b92303 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:49.535113 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0bb6e6db-9fc0-49fc-b393-3b6c49b92303 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 200 len: 1318 microversion: 2.1 time: 0.770851 Jan 28 00:54:49.539940 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 223/469] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:48 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 1318 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:54:49.560176 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-fb38f601-a57f-4574-85a4-15d71d6b7c31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:49.565832 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-fb38f601-a57f-4574-85a4-15d71d6b7c31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:49.578212 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fb38f601-a57f-4574-85a4-15d71d6b7c31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:49.579005 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fb38f601-a57f-4574-85a4-15d71d6b7c31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:49.581258 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fb38f601-a57f-4574-85a4-15d71d6b7c31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:49.581954 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fb38f601-a57f-4574-85a4-15d71d6b7c31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:50.017136 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ea47c093-3b0e-4687-9eec-58a847cf46fa tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:50.046964 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ea47c093-3b0e-4687-9eec-58a847cf46fa tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1266 microversion: 2.1 time: 1.142044 Jan 28 00:54:50.048893 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 247/470] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:48 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1266 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:54:50.066082 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7dc3f73c-29ef-4196-b2f5-251d61699f10 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa2fe297-b26a-410a-aa3a-67b43ce829b8"}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:50.068545 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7dc3f73c-29ef-4196-b2f5-251d61699f10 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:50.097975 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7dc3f73c-29ef-4196-b2f5-251d61699f10 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:50.099177 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7dc3f73c-29ef-4196-b2f5-251d61699f10 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:50.103132 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7dc3f73c-29ef-4196-b2f5-251d61699f10 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:50.110878 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7dc3f73c-29ef-4196-b2f5-251d61699f10 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:50.201816 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-fb38f601-a57f-4574-85a4-15d71d6b7c31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:50.216997 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-fb38f601-a57f-4574-85a4-15d71d6b7c31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:50.219062 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-fb38f601-a57f-4574-85a4-15d71d6b7c31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:50.221402 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-fb38f601-a57f-4574-85a4-15d71d6b7c31 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1739 microversion: 2.20 time: 0.679121 Jan 28 00:54:50.223044 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 224/471] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:49 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1739 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:50.241784 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-80dc0c33-599b-4595-ab37-7872b9a63640 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:50.246544 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-80dc0c33-599b-4595-ab37-7872b9a63640 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:50.284052 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-80dc0c33-599b-4595-ab37-7872b9a63640 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:50.286177 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-80dc0c33-599b-4595-ab37-7872b9a63640 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:50.290996 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-80dc0c33-599b-4595-ab37-7872b9a63640 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:50.294600 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-80dc0c33-599b-4595-ab37-7872b9a63640 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:50.906570 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7dc3f73c-29ef-4196-b2f5-251d61699f10 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.855522 Jan 28 00:54:50.919847 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 248/472] 10.222.0.25 () {60 vars in 1322 bytes} [Fri Jan 28 00:54:50 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/os-volume_attachments => generated 194 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:54:50.950660 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-70d74c8f-b220-4114-ad0d-c81116f4aa46 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:50.952498 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-70d74c8f-b220-4114-ad0d-c81116f4aa46 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:50.995668 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-70d74c8f-b220-4114-ad0d-c81116f4aa46 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:50.997014 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-70d74c8f-b220-4114-ad0d-c81116f4aa46 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:51.004407 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-70d74c8f-b220-4114-ad0d-c81116f4aa46 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:51.005661 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-70d74c8f-b220-4114-ad0d-c81116f4aa46 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:51.996380 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-80dc0c33-599b-4595-ab37-7872b9a63640 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:52.057500 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-80dc0c33-599b-4595-ab37-7872b9a63640 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1567 microversion: 2.1 time: 1.810649 Jan 28 00:54:52.065320 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 225/473] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:50 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1567 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:52.129798 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-fc074440-06e1-45b7-b9cc-7fbd6015df68 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:52.133487 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-fc074440-06e1-45b7-b9cc-7fbd6015df68 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:52.180861 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fc074440-06e1-45b7-b9cc-7fbd6015df68 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:52.182436 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fc074440-06e1-45b7-b9cc-7fbd6015df68 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:52.186328 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fc074440-06e1-45b7-b9cc-7fbd6015df68 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:52.189969 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fc074440-06e1-45b7-b9cc-7fbd6015df68 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:52.354516 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-70d74c8f-b220-4114-ad0d-c81116f4aa46 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:52.440901 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-70d74c8f-b220-4114-ad0d-c81116f4aa46 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 200 len: 1508 microversion: 2.1 time: 1.517181 Jan 28 00:54:52.446036 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 249/474] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:50 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 1508 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:52.461195 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-32af2cca-0d18-4a7b-a256-9025a098b4c1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:52.489039 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-32af2cca-0d18-4a7b-a256-9025a098b4c1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:52.533763 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-32af2cca-0d18-4a7b-a256-9025a098b4c1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:52.534589 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-32af2cca-0d18-4a7b-a256-9025a098b4c1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:52.555474 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-32af2cca-0d18-4a7b-a256-9025a098b4c1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:52.557350 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-32af2cca-0d18-4a7b-a256-9025a098b4c1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:53.049447 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-fc074440-06e1-45b7-b9cc-7fbd6015df68 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:53.100279 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-fc074440-06e1-45b7-b9cc-7fbd6015df68 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1266 microversion: 2.1 time: 1.000740 Jan 28 00:54:53.116907 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 226/475] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:52 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1266 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:53.150302 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-f3c09291-9c6f-44bb-bd69-455252cf9c72 req-cd16fa3b-2687-4024-850f-be1e8616cc63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad5a37e9-9762-4d3f-9756-97f267719f8c", "tag": "ddcf3686-7e23-4e79-8ec0-b709d910fa59"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:53.160520 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:54:53.160520 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:54:53.202133 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-f3c09291-9c6f-44bb-bd69-455252cf9c72 req-cd16fa3b-2687-4024-850f-be1e8616cc63 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:53.204512 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-f3c09291-9c6f-44bb-bd69-455252cf9c72 req-cd16fa3b-2687-4024-850f-be1e8616cc63 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:53.281897 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-f3c09291-9c6f-44bb-bd69-455252cf9c72 req-cd16fa3b-2687-4024-850f-be1e8616cc63 service nova] Creating event network-changed:ddcf3686-7e23-4e79-8ec0-b709d910fa59 for instance ad5a37e9-9762-4d3f-9756-97f267719f8c on hv-cinder-80952 Jan 28 00:54:53.300283 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-f3c09291-9c6f-44bb-bd69-455252cf9c72 req-cd16fa3b-2687-4024-850f-be1e8616cc63 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171592 Jan 28 00:54:53.301362 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 227/476] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:54:53.310340 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ab55cc35-18cf-4bbe-b735-a4facdb439e2 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34273b81-6961-4cde-940a-99a78deb537c", "device": "/dev/sdb"}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:53.323305 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ab55cc35-18cf-4bbe-b735-a4facdb439e2 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:53.355445 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ab55cc35-18cf-4bbe-b735-a4facdb439e2 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:53.362689 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ab55cc35-18cf-4bbe-b735-a4facdb439e2 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:53.369875 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ab55cc35-18cf-4bbe-b735-a4facdb439e2 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:53.370705 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ab55cc35-18cf-4bbe-b735-a4facdb439e2 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:54.087012 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-32af2cca-0d18-4a7b-a256-9025a098b4c1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:54.131615 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-32af2cca-0d18-4a7b-a256-9025a098b4c1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:54.160951 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-32af2cca-0d18-4a7b-a256-9025a098b4c1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:54.162862 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-32af2cca-0d18-4a7b-a256-9025a098b4c1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1739 microversion: 2.20 time: 1.715144 Jan 28 00:54:54.165858 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 250/477] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:52 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1739 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:54.194752 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-121e23f2-1176-459c-a327-cfebd615d0a1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:54.206527 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-121e23f2-1176-459c-a327-cfebd615d0a1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:54.220447 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ab55cc35-18cf-4bbe-b735-a4facdb439e2 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "POST /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.913919 Jan 28 00:54:54.224241 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 228/478] 10.222.0.25 () {60 vars in 1322 bytes} [Fri Jan 28 00:54:53 2022] POST /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee/os-volume_attachments => generated 194 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:54:54.252161 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-121e23f2-1176-459c-a327-cfebd615d0a1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:54.253288 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-121e23f2-1176-459c-a327-cfebd615d0a1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:54.253610 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-638f9394-1500-4a5d-9182-74fd8c00ecdc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:54.254830 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-121e23f2-1176-459c-a327-cfebd615d0a1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:54.256568 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-638f9394-1500-4a5d-9182-74fd8c00ecdc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:54.258195 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-121e23f2-1176-459c-a327-cfebd615d0a1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:54.298497 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-638f9394-1500-4a5d-9182-74fd8c00ecdc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:54.307687 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-638f9394-1500-4a5d-9182-74fd8c00ecdc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:54.315227 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-638f9394-1500-4a5d-9182-74fd8c00ecdc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:54.325245 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-638f9394-1500-4a5d-9182-74fd8c00ecdc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:55.668853 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-121e23f2-1176-459c-a327-cfebd615d0a1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:55.711594 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-121e23f2-1176-459c-a327-cfebd615d0a1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1547 microversion: 2.1 time: 1.543208 Jan 28 00:54:55.716475 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 251/479] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:54 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1547 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:55.737031 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-c3f2604d-5b9c-424e-b3a3-faba132cb1e3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:55.754264 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-c3f2604d-5b9c-424e-b3a3-faba132cb1e3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:55.772011 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-638f9394-1500-4a5d-9182-74fd8c00ecdc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:55.791492 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c3f2604d-5b9c-424e-b3a3-faba132cb1e3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:55.792891 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c3f2604d-5b9c-424e-b3a3-faba132cb1e3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:55.795357 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-638f9394-1500-4a5d-9182-74fd8c00ecdc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1266 microversion: 2.1 time: 1.568549 Jan 28 00:54:55.795964 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 229/480] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:54 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1266 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:55.797974 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c3f2604d-5b9c-424e-b3a3-faba132cb1e3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:55.801621 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c3f2604d-5b9c-424e-b3a3-faba132cb1e3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:55.826819 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-9e52fed0-d3b1-4750-9163-2e9be64992c0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:55.834625 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-9e52fed0-d3b1-4750-9163-2e9be64992c0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:55.877417 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9e52fed0-d3b1-4750-9163-2e9be64992c0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:55.878453 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9e52fed0-d3b1-4750-9163-2e9be64992c0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:55.888144 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9e52fed0-d3b1-4750-9163-2e9be64992c0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:55.888963 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9e52fed0-d3b1-4750-9163-2e9be64992c0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:56.402196 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-9e52fed0-d3b1-4750-9163-2e9be64992c0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] HTTP exception thrown: Cannot 'detach_volume' instance 35f84832-ed83-48ac-a8cb-f3a87abd47bd while it is in vm_state rescued Jan 28 00:54:56.403230 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-9e52fed0-d3b1-4750-9163-2e9be64992c0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Returning 409 to user: Cannot 'detach_volume' instance 35f84832-ed83-48ac-a8cb-f3a87abd47bd while it is in vm_state rescued {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:54:56.408557 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-9e52fed0-d3b1-4750-9163-2e9be64992c0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "DELETE /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/os-volume_attachments/03f44f18-fd98-4da9-82c3-6af7fcfdb8aa" status: 409 len: 152 microversion: 2.1 time: 0.597376 Jan 28 00:54:56.412812 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 230/481] 10.222.0.25 () {58 vars in 1415 bytes} [Fri Jan 28 00:54:55 2022] DELETE /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/os-volume_attachments/03f44f18-fd98-4da9-82c3-6af7fcfdb8aa => generated 152 bytes in 616 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 28 00:54:56.434444 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-cdb711d1-4d5f-4351-9a03-376ed5841c7c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:56.441311 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-cdb711d1-4d5f-4351-9a03-376ed5841c7c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:56.475326 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cdb711d1-4d5f-4351-9a03-376ed5841c7c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:56.475326 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cdb711d1-4d5f-4351-9a03-376ed5841c7c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:56.475326 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cdb711d1-4d5f-4351-9a03-376ed5841c7c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:56.475326 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cdb711d1-4d5f-4351-9a03-376ed5841c7c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:56.635376 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-cdb711d1-4d5f-4351-9a03-376ed5841c7c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "POST /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/action" status: 202 len: 0 microversion: 2.1 time: 0.214859 Jan 28 00:54:56.637174 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 231/482] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:56 2022] POST /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:54:56.647292 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a178d99a-963d-4530-803d-03cc3dc4529d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:56.648288 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a178d99a-963d-4530-803d-03cc3dc4529d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:56.672428 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a178d99a-963d-4530-803d-03cc3dc4529d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:56.676177 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a178d99a-963d-4530-803d-03cc3dc4529d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:56.678931 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a178d99a-963d-4530-803d-03cc3dc4529d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:56.679758 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a178d99a-963d-4530-803d-03cc3dc4529d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:56.688659 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c3f2604d-5b9c-424e-b3a3-faba132cb1e3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:56.754036 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c3f2604d-5b9c-424e-b3a3-faba132cb1e3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:56.774654 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c3f2604d-5b9c-424e-b3a3-faba132cb1e3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:56.784037 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-c3f2604d-5b9c-424e-b3a3-faba132cb1e3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1739 microversion: 2.20 time: 1.065110 Jan 28 00:54:56.790980 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 252/483] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:55 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1739 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:56.828955 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3ff816c6-36ae-4be2-a1fb-4f4b4e14fe77 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:56.834747 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3ff816c6-36ae-4be2-a1fb-4f4b4e14fe77 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:56.880642 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3ff816c6-36ae-4be2-a1fb-4f4b4e14fe77 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:56.881641 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3ff816c6-36ae-4be2-a1fb-4f4b4e14fe77 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:56.883579 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3ff816c6-36ae-4be2-a1fb-4f4b4e14fe77 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:56.884595 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3ff816c6-36ae-4be2-a1fb-4f4b4e14fe77 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:57.917566 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3ff816c6-36ae-4be2-a1fb-4f4b4e14fe77 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:57.944058 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3ff816c6-36ae-4be2-a1fb-4f4b4e14fe77 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1266 microversion: 2.1 time: 1.122684 Jan 28 00:54:57.968775 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 253/484] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:56 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1266 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:57.992758 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-12207651-b6d7-4967-99f4-1c67ea772385 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:57.994030 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-12207651-b6d7-4967-99f4-1c67ea772385 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:58.006110 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-12207651-b6d7-4967-99f4-1c67ea772385 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:58.007431 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-12207651-b6d7-4967-99f4-1c67ea772385 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:58.009173 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-12207651-b6d7-4967-99f4-1c67ea772385 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:58.010297 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-12207651-b6d7-4967-99f4-1c67ea772385 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:58.482679 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a178d99a-963d-4530-803d-03cc3dc4529d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:58.508845 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a178d99a-963d-4530-803d-03cc3dc4529d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1555 microversion: 2.1 time: 1.866079 Jan 28 00:54:58.514500 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 232/485] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:56 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1555 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:54:58.969026 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-12207651-b6d7-4967-99f4-1c67ea772385 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:58.976505 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-16810b05-b203-4e9d-bfba-a6d1024eb64e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:58.980580 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-16810b05-b203-4e9d-bfba-a6d1024eb64e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:59.004785 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-16810b05-b203-4e9d-bfba-a6d1024eb64e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:59.022656 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-16810b05-b203-4e9d-bfba-a6d1024eb64e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:59.024876 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-16810b05-b203-4e9d-bfba-a6d1024eb64e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:59.025954 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-12207651-b6d7-4967-99f4-1c67ea772385 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:59.029835 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-12207651-b6d7-4967-99f4-1c67ea772385 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:59.037672 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-16810b05-b203-4e9d-bfba-a6d1024eb64e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:59.045348 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-12207651-b6d7-4967-99f4-1c67ea772385 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1721 microversion: 2.20 time: 1.073439 Jan 28 00:54:59.049271 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 254/486] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:54:57 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1721 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:54:59.542748 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-16810b05-b203-4e9d-bfba-a6d1024eb64e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:54:59.545187 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ebaa4710-902b-4de6-8d69-912f8fee36c9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:54:59.546668 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ebaa4710-902b-4de6-8d69-912f8fee36c9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:54:59.556240 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-16810b05-b203-4e9d-bfba-a6d1024eb64e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1266 microversion: 2.1 time: 0.584644 Jan 28 00:54:59.573566 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 233/487] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:58 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1266 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:54:59.576403 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ebaa4710-902b-4de6-8d69-912f8fee36c9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:59.577429 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ebaa4710-902b-4de6-8d69-912f8fee36c9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:59.579264 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ebaa4710-902b-4de6-8d69-912f8fee36c9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:59.585345 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ebaa4710-902b-4de6-8d69-912f8fee36c9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:59.853626 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7a3bc209-3396-4347-9418-dc167034bf13 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:54:59.861493 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7a3bc209-3396-4347-9418-dc167034bf13 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:54:59.862390 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7a3bc209-3396-4347-9418-dc167034bf13 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:54:59.975857 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7a3bc209-3396-4347-9418-dc167034bf13 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Going to try to stop instance {{(pid=127863) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 28 00:55:00.090437 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7a3bc209-3396-4347-9418-dc167034bf13 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 202 len: 0 microversion: 2.1 time: 0.243369 Jan 28 00:55:00.092180 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 234/488] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:54:59 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:55:00.104350 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-46d94a84-77c7-4289-9822-25d5dcce513b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:00.105379 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-46d94a84-77c7-4289-9822-25d5dcce513b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:00.116078 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-46d94a84-77c7-4289-9822-25d5dcce513b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:00.117187 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-46d94a84-77c7-4289-9822-25d5dcce513b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:00.119523 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-46d94a84-77c7-4289-9822-25d5dcce513b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:00.120150 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-46d94a84-77c7-4289-9822-25d5dcce513b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:00.379145 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ebaa4710-902b-4de6-8d69-912f8fee36c9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:00.388417 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ebaa4710-902b-4de6-8d69-912f8fee36c9 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1555 microversion: 2.1 time: 0.851359 Jan 28 00:55:00.395507 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 255/489] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:54:59 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1555 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:00.401178 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-90262a29-ec5d-4012-9dec-f10988ee5bc3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:00.408063 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-90262a29-ec5d-4012-9dec-f10988ee5bc3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:00.425299 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-90262a29-ec5d-4012-9dec-f10988ee5bc3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:00.426261 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-90262a29-ec5d-4012-9dec-f10988ee5bc3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:00.432722 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-90262a29-ec5d-4012-9dec-f10988ee5bc3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:00.433749 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-90262a29-ec5d-4012-9dec-f10988ee5bc3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:00.481991 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-46d94a84-77c7-4289-9822-25d5dcce513b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:00.499046 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-46d94a84-77c7-4289-9822-25d5dcce513b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:00.501693 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-46d94a84-77c7-4289-9822-25d5dcce513b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:00.503199 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-46d94a84-77c7-4289-9822-25d5dcce513b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1721 microversion: 2.20 time: 0.403520 Jan 28 00:55:00.508453 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 235/490] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:00 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1721 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:00.589976 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-6c545b8d-4aee-4940-a830-c0ea739b2c7a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:00.590784 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-6c545b8d-4aee-4940-a830-c0ea739b2c7a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:00.606615 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6c545b8d-4aee-4940-a830-c0ea739b2c7a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:00.607627 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6c545b8d-4aee-4940-a830-c0ea739b2c7a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:00.609946 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6c545b8d-4aee-4940-a830-c0ea739b2c7a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:00.612673 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6c545b8d-4aee-4940-a830-c0ea739b2c7a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:00.770535 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-90262a29-ec5d-4012-9dec-f10988ee5bc3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:00.787549 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-90262a29-ec5d-4012-9dec-f10988ee5bc3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.385238 Jan 28 00:55:00.788378 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 256/491] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:00 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:00.977788 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-6c545b8d-4aee-4940-a830-c0ea739b2c7a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:01.000243 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-6c545b8d-4aee-4940-a830-c0ea739b2c7a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1266 microversion: 2.1 time: 0.421343 Jan 28 00:55:01.016310 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 236/492] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:00 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1266 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:01.429879 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7b2a1524-7a13-49f5-908d-3d259e7b87c4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:01.430647 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7b2a1524-7a13-49f5-908d-3d259e7b87c4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:01.439804 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7b2a1524-7a13-49f5-908d-3d259e7b87c4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:01.445608 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7b2a1524-7a13-49f5-908d-3d259e7b87c4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:01.446775 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7b2a1524-7a13-49f5-908d-3d259e7b87c4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:01.447678 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7b2a1524-7a13-49f5-908d-3d259e7b87c4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:01.540769 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d37bf458-32d9-4ca8-bee9-3d48621e8bca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:01.541397 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d37bf458-32d9-4ca8-bee9-3d48621e8bca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:01.552256 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d37bf458-32d9-4ca8-bee9-3d48621e8bca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:01.552718 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d37bf458-32d9-4ca8-bee9-3d48621e8bca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:01.553534 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d37bf458-32d9-4ca8-bee9-3d48621e8bca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:01.553976 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d37bf458-32d9-4ca8-bee9-3d48621e8bca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:01.792701 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7b2a1524-7a13-49f5-908d-3d259e7b87c4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:01.807630 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7b2a1524-7a13-49f5-908d-3d259e7b87c4 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1561 microversion: 2.1 time: 0.381173 Jan 28 00:55:01.812697 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 257/493] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:01 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1561 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:01.831769 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-a579e30c-a737-4739-b5e4-c0499cec5296 req-6cd3eada-a14b-49e8-b94d-86941e7bd4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4", "name": "network-vif-unplugged", "status": "completed", "tag": "83fc2ec7-8030-466d-ac4d-dc369ac1f250"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:55:01.834687 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:55:01.834687 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:55:01.861827 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-a579e30c-a737-4739-b5e4-c0499cec5296 req-6cd3eada-a14b-49e8-b94d-86941e7bd4e3 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:01.871962 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-a579e30c-a737-4739-b5e4-c0499cec5296 req-6cd3eada-a14b-49e8-b94d-86941e7bd4e3 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:01.904277 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-a579e30c-a737-4739-b5e4-c0499cec5296 req-6cd3eada-a14b-49e8-b94d-86941e7bd4e3 service nova] Creating event network-vif-unplugged:83fc2ec7-8030-466d-ac4d-dc369ac1f250 for instance 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 on hv-cinder-80952 Jan 28 00:55:01.919036 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-a579e30c-a737-4739-b5e4-c0499cec5296 req-6cd3eada-a14b-49e8-b94d-86941e7bd4e3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103684 Jan 28 00:55:01.920114 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 258/494] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:55:01.945237 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d37bf458-32d9-4ca8-bee9-3d48621e8bca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:01.951455 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-6da4e613-aa7a-425e-801b-9c15f9478270 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:01.956890 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-6da4e613-aa7a-425e-801b-9c15f9478270 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:01.958623 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d37bf458-32d9-4ca8-bee9-3d48621e8bca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:01.962936 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d37bf458-32d9-4ca8-bee9-3d48621e8bca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:01.967198 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d37bf458-32d9-4ca8-bee9-3d48621e8bca tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1721 microversion: 2.20 time: 0.430077 Jan 28 00:55:01.968846 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 237/495] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:01 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1721 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:55:02.000202 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6da4e613-aa7a-425e-801b-9c15f9478270 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:02.001070 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6da4e613-aa7a-425e-801b-9c15f9478270 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:02.002384 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6da4e613-aa7a-425e-801b-9c15f9478270 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:02.003593 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6da4e613-aa7a-425e-801b-9c15f9478270 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:02.026973 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a130ab2b-58eb-429e-9651-03d4dcdd90b8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:02.030131 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a130ab2b-58eb-429e-9651-03d4dcdd90b8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:02.051517 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a130ab2b-58eb-429e-9651-03d4dcdd90b8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:02.057064 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a130ab2b-58eb-429e-9651-03d4dcdd90b8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:02.061501 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a130ab2b-58eb-429e-9651-03d4dcdd90b8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:02.063638 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a130ab2b-58eb-429e-9651-03d4dcdd90b8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:02.461496 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-6da4e613-aa7a-425e-801b-9c15f9478270 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:02.503246 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-6da4e613-aa7a-425e-801b-9c15f9478270 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.571638 Jan 28 00:55:02.524615 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 259/496] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:01 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:02.537977 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-fdcaab41-afa9-4a7f-96eb-cb424a80a22c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:02.547804 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-fdcaab41-afa9-4a7f-96eb-cb424a80a22c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:02.571079 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fdcaab41-afa9-4a7f-96eb-cb424a80a22c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:02.572572 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fdcaab41-afa9-4a7f-96eb-cb424a80a22c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:02.576356 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fdcaab41-afa9-4a7f-96eb-cb424a80a22c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:02.580404 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fdcaab41-afa9-4a7f-96eb-cb424a80a22c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:02.800966 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a130ab2b-58eb-429e-9651-03d4dcdd90b8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:02.823635 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a130ab2b-58eb-429e-9651-03d4dcdd90b8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1266 microversion: 2.1 time: 0.799150 Jan 28 00:55:02.831437 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 238/497] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:02 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1266 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:02.839299 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.objects.instance [None req-fdcaab41-afa9-4a7f-96eb-cb424a80a22c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lazy-loading 'services' on Instance uuid 35f84832-ed83-48ac-a8cb-f3a87abd47bd {{(pid=127862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:55:02.997139 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-00f2240f-9789-4baa-b7a8-821f174e277b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:02.998475 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-00f2240f-9789-4baa-b7a8-821f174e277b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:03.021426 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-00f2240f-9789-4baa-b7a8-821f174e277b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:03.034084 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-00f2240f-9789-4baa-b7a8-821f174e277b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:03.038827 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-00f2240f-9789-4baa-b7a8-821f174e277b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:03.039525 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-00f2240f-9789-4baa-b7a8-821f174e277b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:03.148181 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-fdcaab41-afa9-4a7f-96eb-cb424a80a22c tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "DELETE /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/os-volume_attachments/03f44f18-fd98-4da9-82c3-6af7fcfdb8aa" status: 202 len: 0 microversion: 2.1 time: 0.618830 Jan 28 00:55:03.151038 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 260/498] 10.222.0.25 () {58 vars in 1415 bytes} [Fri Jan 28 00:55:02 2022] DELETE /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/os-volume_attachments/03f44f18-fd98-4da9-82c3-6af7fcfdb8aa => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:55:03.175760 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-8ecf6726-a25e-4b66-9dc2-790cc64629db tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:03.181909 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-8ecf6726-a25e-4b66-9dc2-790cc64629db tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:03.205413 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8ecf6726-a25e-4b66-9dc2-790cc64629db tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:03.205863 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8ecf6726-a25e-4b66-9dc2-790cc64629db tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:03.220854 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8ecf6726-a25e-4b66-9dc2-790cc64629db tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:03.222277 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8ecf6726-a25e-4b66-9dc2-790cc64629db tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:03.335516 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-8ecf6726-a25e-4b66-9dc2-790cc64629db tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178785 Jan 28 00:55:03.346142 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 261/499] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 00:55:03 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:55:03.538605 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-de34db30-6a8e-4b02-9527-1a8cb1bc1235 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:03.541899 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-de34db30-6a8e-4b02-9527-1a8cb1bc1235 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:03.589954 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-de34db30-6a8e-4b02-9527-1a8cb1bc1235 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:03.591944 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-de34db30-6a8e-4b02-9527-1a8cb1bc1235 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:03.595803 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-de34db30-6a8e-4b02-9527-1a8cb1bc1235 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:03.596630 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-de34db30-6a8e-4b02-9527-1a8cb1bc1235 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:03.617779 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-00f2240f-9789-4baa-b7a8-821f174e277b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:03.632766 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-00f2240f-9789-4baa-b7a8-821f174e277b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:03.635012 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-00f2240f-9789-4baa-b7a8-821f174e277b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:03.637217 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-00f2240f-9789-4baa-b7a8-821f174e277b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1721 microversion: 2.20 time: 0.646305 Jan 28 00:55:03.639484 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 239/500] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:02 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1721 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:55:03.847077 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-64a17960-6485-48f7-9f21-7b2489e32954 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:03.848705 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-64a17960-6485-48f7-9f21-7b2489e32954 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:03.870305 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-64a17960-6485-48f7-9f21-7b2489e32954 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:03.873068 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-64a17960-6485-48f7-9f21-7b2489e32954 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:03.877242 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-64a17960-6485-48f7-9f21-7b2489e32954 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:03.880478 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-64a17960-6485-48f7-9f21-7b2489e32954 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:03.915648 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-de34db30-6a8e-4b02-9527-1a8cb1bc1235 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:03.935069 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-de34db30-6a8e-4b02-9527-1a8cb1bc1235 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.406870 Jan 28 00:55:03.936624 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 262/501] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:03 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:04.373240 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9a6e483f-df5c-418d-b791-7f366a50ea90 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:04.382362 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9a6e483f-df5c-418d-b791-7f366a50ea90 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:04.414748 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9a6e483f-df5c-418d-b791-7f366a50ea90 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:04.415301 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9a6e483f-df5c-418d-b791-7f366a50ea90 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:04.428659 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9a6e483f-df5c-418d-b791-7f366a50ea90 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:04.429673 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9a6e483f-df5c-418d-b791-7f366a50ea90 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:04.440375 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-64a17960-6485-48f7-9f21-7b2489e32954 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:04.458250 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-64a17960-6485-48f7-9f21-7b2489e32954 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1266 microversion: 2.1 time: 0.618999 Jan 28 00:55:04.462918 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 240/502] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:03 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1266 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:04.508043 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9a6e483f-df5c-418d-b791-7f366a50ea90 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157415 Jan 28 00:55:04.508656 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 263/503] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 00:55:04 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:55:04.670091 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-6d74efb8-6f44-4b7e-91a1-2e21e7d17a3f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:04.670726 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-6d74efb8-6f44-4b7e-91a1-2e21e7d17a3f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:04.703007 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6d74efb8-6f44-4b7e-91a1-2e21e7d17a3f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:04.703788 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6d74efb8-6f44-4b7e-91a1-2e21e7d17a3f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:04.705014 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6d74efb8-6f44-4b7e-91a1-2e21e7d17a3f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:04.705869 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6d74efb8-6f44-4b7e-91a1-2e21e7d17a3f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:04.959825 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d2bf7487-0400-4c3e-b2e9-afd1f1e7c576 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:04.961065 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d2bf7487-0400-4c3e-b2e9-afd1f1e7c576 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:04.985234 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d2bf7487-0400-4c3e-b2e9-afd1f1e7c576 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:04.987181 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d2bf7487-0400-4c3e-b2e9-afd1f1e7c576 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:04.988248 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d2bf7487-0400-4c3e-b2e9-afd1f1e7c576 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:04.989704 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d2bf7487-0400-4c3e-b2e9-afd1f1e7c576 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:05.098758 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-6d74efb8-6f44-4b7e-91a1-2e21e7d17a3f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:05.120569 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-6d74efb8-6f44-4b7e-91a1-2e21e7d17a3f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:05.123108 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-6d74efb8-6f44-4b7e-91a1-2e21e7d17a3f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:05.125634 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-6d74efb8-6f44-4b7e-91a1-2e21e7d17a3f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1664 microversion: 2.20 time: 0.462220 Jan 28 00:55:05.126241 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 241/504] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:04 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1664 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:05.160266 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c9a86743-e449-4797-9a27-342a5c3f112e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d210f2c9-90d1-4ccb-a202-31e2631bdab7"}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:55:05.161445 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c9a86743-e449-4797-9a27-342a5c3f112e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:05.179784 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c9a86743-e449-4797-9a27-342a5c3f112e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:05.180264 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c9a86743-e449-4797-9a27-342a5c3f112e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:05.181101 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c9a86743-e449-4797-9a27-342a5c3f112e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:05.181552 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c9a86743-e449-4797-9a27-342a5c3f112e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:05.522780 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d2bf7487-0400-4c3e-b2e9-afd1f1e7c576 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:05.546268 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d2bf7487-0400-4c3e-b2e9-afd1f1e7c576 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.594819 Jan 28 00:55:05.547224 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 264/505] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:04 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:05.568214 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9afd0ed3-c18a-4c3d-899b-0a12fe19749d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:05.600049 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9afd0ed3-c18a-4c3d-899b-0a12fe19749d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:05.646125 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9afd0ed3-c18a-4c3d-899b-0a12fe19749d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:05.646985 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9afd0ed3-c18a-4c3d-899b-0a12fe19749d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:05.648734 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9afd0ed3-c18a-4c3d-899b-0a12fe19749d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:05.649376 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9afd0ed3-c18a-4c3d-899b-0a12fe19749d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:06.122626 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c9a86743-e449-4797-9a27-342a5c3f112e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.965823 Jan 28 00:55:06.134934 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 242/506] 10.222.0.25 () {62 vars in 1363 bytes} [Fri Jan 28 00:55:05 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/os-volume_attachments => generated 188 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:55:06.150549 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c6d038a9-36eb-4700-bb89-2db3bac6bdbb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:06.152778 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c6d038a9-36eb-4700-bb89-2db3bac6bdbb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:06.173716 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c6d038a9-36eb-4700-bb89-2db3bac6bdbb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:06.178210 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9afd0ed3-c18a-4c3d-899b-0a12fe19749d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:06.187561 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c6d038a9-36eb-4700-bb89-2db3bac6bdbb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:06.194416 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c6d038a9-36eb-4700-bb89-2db3bac6bdbb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:06.196656 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c6d038a9-36eb-4700-bb89-2db3bac6bdbb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:06.206324 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9afd0ed3-c18a-4c3d-899b-0a12fe19749d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1266 microversion: 2.1 time: 0.650607 Jan 28 00:55:06.208403 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 265/507] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:05 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1266 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:06.381484 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c6d038a9-36eb-4700-bb89-2db3bac6bdbb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.240192 Jan 28 00:55:06.384171 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 243/508] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 00:55:06 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/os-volume_attachments => generated 197 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:55:06.515564 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-e718469d-3192-4511-83a4-d30f58985e69 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:55:06.515988 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-e718469d-3192-4511-83a4-d30f58985e69 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:06.537794 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e718469d-3192-4511-83a4-d30f58985e69 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:06.541248 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e718469d-3192-4511-83a4-d30f58985e69 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:06.545971 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e718469d-3192-4511-83a4-d30f58985e69 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:06.549965 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e718469d-3192-4511-83a4-d30f58985e69 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:06.586944 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4c524bc1-7365-4409-8d11-0300f3e97f56 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:06.588857 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4c524bc1-7365-4409-8d11-0300f3e97f56 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:06.621233 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4c524bc1-7365-4409-8d11-0300f3e97f56 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:06.623330 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4c524bc1-7365-4409-8d11-0300f3e97f56 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:06.628712 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4c524bc1-7365-4409-8d11-0300f3e97f56 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:06.630377 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4c524bc1-7365-4409-8d11-0300f3e97f56 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:06.879833 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-e718469d-3192-4511-83a4-d30f58985e69 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action" status: 202 len: 0 microversion: 2.20 time: 0.369045 Jan 28 00:55:06.881869 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 266/509] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:55:06 2022] POST /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 28 00:55:06.901436 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-02b09a0d-70f2-41e8-ad35-5aa56e88c7ca req-9d82cfe1-4d1b-41ce-8b03-8d865f7a1638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5a37e9-9762-4d3f-9756-97f267719f8c", "name": "network-vif-plugged", "status": "completed", "tag": "ddcf3686-7e23-4e79-8ec0-b709d910fa59"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:55:06.904099 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:55:06.904099 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:55:06.914546 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-02b09a0d-70f2-41e8-ad35-5aa56e88c7ca req-9d82cfe1-4d1b-41ce-8b03-8d865f7a1638 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:06.915026 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-02b09a0d-70f2-41e8-ad35-5aa56e88c7ca req-9d82cfe1-4d1b-41ce-8b03-8d865f7a1638 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:06.941310 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-02b09a0d-70f2-41e8-ad35-5aa56e88c7ca req-9d82cfe1-4d1b-41ce-8b03-8d865f7a1638 service nova] Creating event network-vif-plugged:ddcf3686-7e23-4e79-8ec0-b709d910fa59 for instance ad5a37e9-9762-4d3f-9756-97f267719f8c on hv-cinder-80952 Jan 28 00:55:06.948466 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-02b09a0d-70f2-41e8-ad35-5aa56e88c7ca req-9d82cfe1-4d1b-41ce-8b03-8d865f7a1638 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064208 Jan 28 00:55:06.949355 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 267/510] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:55:06.961125 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-30c98990-952d-404f-8431-e3a49d340ac4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:06.962544 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-30c98990-952d-404f-8431-e3a49d340ac4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:06.971649 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-30c98990-952d-404f-8431-e3a49d340ac4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:06.972211 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-30c98990-952d-404f-8431-e3a49d340ac4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:06.973119 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-30c98990-952d-404f-8431-e3a49d340ac4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:06.973641 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-30c98990-952d-404f-8431-e3a49d340ac4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:07.339447 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4c524bc1-7365-4409-8d11-0300f3e97f56 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:07.445705 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4c524bc1-7365-4409-8d11-0300f3e97f56 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.883291 Jan 28 00:55:07.495489 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 244/511] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:06 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:07.525703 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-00227191-10f2-4698-9a7c-50875a58bd2c tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:07.533237 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-00227191-10f2-4698-9a7c-50875a58bd2c tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:07.564698 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-00227191-10f2-4698-9a7c-50875a58bd2c tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:07.566971 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-00227191-10f2-4698-9a7c-50875a58bd2c tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:07.570644 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-00227191-10f2-4698-9a7c-50875a58bd2c tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:07.574032 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-00227191-10f2-4698-9a7c-50875a58bd2c tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:07.946785 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-30c98990-952d-404f-8431-e3a49d340ac4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:07.982189 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-30c98990-952d-404f-8431-e3a49d340ac4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:07.994525 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-30c98990-952d-404f-8431-e3a49d340ac4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:08.001285 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-30c98990-952d-404f-8431-e3a49d340ac4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1750 microversion: 2.20 time: 1.050109 Jan 28 00:55:08.002624 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 268/512] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:06 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1750 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:08.016851 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1505ad12-50a6-4b70-b5ac-d39f31471efb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:08.020122 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1505ad12-50a6-4b70-b5ac-d39f31471efb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:08.038771 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1505ad12-50a6-4b70-b5ac-d39f31471efb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:08.043660 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1505ad12-50a6-4b70-b5ac-d39f31471efb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:08.046086 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1505ad12-50a6-4b70-b5ac-d39f31471efb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:08.047572 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1505ad12-50a6-4b70-b5ac-d39f31471efb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:08.165130 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1505ad12-50a6-4b70-b5ac-d39f31471efb tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160285 Jan 28 00:55:08.172439 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 269/513] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 00:55:08 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:55:08.264498 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-00227191-10f2-4698-9a7c-50875a58bd2c tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:08.312878 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-00227191-10f2-4698-9a7c-50875a58bd2c tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1266 microversion: 2.1 time: 0.804376 Jan 28 00:55:08.337106 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 245/514] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:07 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1266 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:08.497876 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-068ceda7-fdaa-4608-8b27-26763b47119f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:08.498810 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-068ceda7-fdaa-4608-8b27-26763b47119f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:08.529117 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-068ceda7-fdaa-4608-8b27-26763b47119f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:08.529854 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-068ceda7-fdaa-4608-8b27-26763b47119f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:08.556756 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-068ceda7-fdaa-4608-8b27-26763b47119f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:08.557685 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-068ceda7-fdaa-4608-8b27-26763b47119f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:08.971062 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-068ceda7-fdaa-4608-8b27-26763b47119f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:08.989769 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-068ceda7-fdaa-4608-8b27-26763b47119f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.497941 Jan 28 00:55:08.991692 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 270/515] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:08 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:09.041505 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7adbf3a1-b1c8-4c35-bcb8-8e310da5ae95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:09.047123 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7adbf3a1-b1c8-4c35-bcb8-8e310da5ae95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:09.104156 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7adbf3a1-b1c8-4c35-bcb8-8e310da5ae95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:09.105305 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7adbf3a1-b1c8-4c35-bcb8-8e310da5ae95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:09.115822 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7adbf3a1-b1c8-4c35-bcb8-8e310da5ae95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:09.117327 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7adbf3a1-b1c8-4c35-bcb8-8e310da5ae95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:09.180827 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3db5c9df-4598-4b4c-af79-a4e57d86c030 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:09.182226 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3db5c9df-4598-4b4c-af79-a4e57d86c030 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:09.200338 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3db5c9df-4598-4b4c-af79-a4e57d86c030 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:09.201691 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3db5c9df-4598-4b4c-af79-a4e57d86c030 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:09.204101 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3db5c9df-4598-4b4c-af79-a4e57d86c030 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:09.205267 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3db5c9df-4598-4b4c-af79-a4e57d86c030 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:09.304730 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3db5c9df-4598-4b4c-af79-a4e57d86c030 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.125007 Jan 28 00:55:09.305388 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 271/516] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 00:55:09 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:55:09.344859 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f77c9c6a-41cb-4492-ac20-0cddd65c48c7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:09.345787 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f77c9c6a-41cb-4492-ac20-0cddd65c48c7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:09.361987 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f77c9c6a-41cb-4492-ac20-0cddd65c48c7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:09.362464 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f77c9c6a-41cb-4492-ac20-0cddd65c48c7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:09.363322 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f77c9c6a-41cb-4492-ac20-0cddd65c48c7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:09.363782 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f77c9c6a-41cb-4492-ac20-0cddd65c48c7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:09.576611 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7adbf3a1-b1c8-4c35-bcb8-8e310da5ae95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:09.599232 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7adbf3a1-b1c8-4c35-bcb8-8e310da5ae95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:09.602934 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7adbf3a1-b1c8-4c35-bcb8-8e310da5ae95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:09.609935 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7adbf3a1-b1c8-4c35-bcb8-8e310da5ae95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1750 microversion: 2.20 time: 0.576022 Jan 28 00:55:09.612334 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 246/517] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:09 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1750 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:09.803257 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f77c9c6a-41cb-4492-ac20-0cddd65c48c7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:09.823558 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f77c9c6a-41cb-4492-ac20-0cddd65c48c7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1266 microversion: 2.1 time: 0.483294 Jan 28 00:55:09.845033 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 272/518] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:09 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1266 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:10.023657 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-63318992-1755-43c5-b7ea-5e1737115137 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:10.024876 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-63318992-1755-43c5-b7ea-5e1737115137 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:10.038892 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-63318992-1755-43c5-b7ea-5e1737115137 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:10.040138 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-63318992-1755-43c5-b7ea-5e1737115137 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:10.042207 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-63318992-1755-43c5-b7ea-5e1737115137 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:10.044092 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-63318992-1755-43c5-b7ea-5e1737115137 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:10.375126 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-63318992-1755-43c5-b7ea-5e1737115137 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:10.398956 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-63318992-1755-43c5-b7ea-5e1737115137 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.379974 Jan 28 00:55:10.406782 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 247/519] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:10 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:10.661811 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-62e0a640-8707-4499-895b-7ae643895407 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:10.668861 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-62e0a640-8707-4499-895b-7ae643895407 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:10.722052 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-62e0a640-8707-4499-895b-7ae643895407 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:10.731828 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-62e0a640-8707-4499-895b-7ae643895407 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:10.735336 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-62e0a640-8707-4499-895b-7ae643895407 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:10.738628 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-62e0a640-8707-4499-895b-7ae643895407 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:10.872702 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-66f47308-d5f3-4d27-9373-ff283f9dbb6e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:10.876575 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-66f47308-d5f3-4d27-9373-ff283f9dbb6e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:10.905898 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-66f47308-d5f3-4d27-9373-ff283f9dbb6e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:10.908686 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-66f47308-d5f3-4d27-9373-ff283f9dbb6e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:10.911439 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-66f47308-d5f3-4d27-9373-ff283f9dbb6e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:10.912278 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-66f47308-d5f3-4d27-9373-ff283f9dbb6e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:11.959459 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-66f47308-d5f3-4d27-9373-ff283f9dbb6e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:11.997954 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-62e0a640-8707-4499-895b-7ae643895407 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:12.005412 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-66f47308-d5f3-4d27-9373-ff283f9dbb6e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1266 microversion: 2.1 time: 1.145374 Jan 28 00:55:12.013171 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-62e0a640-8707-4499-895b-7ae643895407 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:12.021725 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 248/520] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:10 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1266 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:12.024559 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-62e0a640-8707-4499-895b-7ae643895407 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:12.025996 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-62e0a640-8707-4499-895b-7ae643895407 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1750 microversion: 2.20 time: 1.383916 Jan 28 00:55:12.028435 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 273/521] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:10 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1750 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:12.054861 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d585bf00-4059-4006-a898-3085b660a43a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:12.056720 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d585bf00-4059-4006-a898-3085b660a43a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:12.086907 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d585bf00-4059-4006-a898-3085b660a43a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:12.088246 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d585bf00-4059-4006-a898-3085b660a43a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:12.091630 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d585bf00-4059-4006-a898-3085b660a43a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:12.095798 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d585bf00-4059-4006-a898-3085b660a43a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:12.572322 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d585bf00-4059-4006-a898-3085b660a43a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:12.589612 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d585bf00-4059-4006-a898-3085b660a43a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.565890 Jan 28 00:55:12.591668 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 249/522] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:12 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:13.044972 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d7b06e5f-58fd-4b7f-93bd-bc6c9f91a738 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:13.046226 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d7b06e5f-58fd-4b7f-93bd-bc6c9f91a738 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:13.065690 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f6a2f32c-0ec4-442a-9b47-117326581c48 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:13.068256 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f6a2f32c-0ec4-442a-9b47-117326581c48 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:13.069132 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d7b06e5f-58fd-4b7f-93bd-bc6c9f91a738 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:13.072087 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d7b06e5f-58fd-4b7f-93bd-bc6c9f91a738 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:13.073218 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d7b06e5f-58fd-4b7f-93bd-bc6c9f91a738 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:13.076415 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d7b06e5f-58fd-4b7f-93bd-bc6c9f91a738 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:13.097491 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f6a2f32c-0ec4-442a-9b47-117326581c48 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:13.104529 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f6a2f32c-0ec4-442a-9b47-117326581c48 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:13.109650 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f6a2f32c-0ec4-442a-9b47-117326581c48 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:13.115788 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f6a2f32c-0ec4-442a-9b47-117326581c48 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:14.075136 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f6a2f32c-0ec4-442a-9b47-117326581c48 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:14.111749 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f6a2f32c-0ec4-442a-9b47-117326581c48 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:14.116121 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f6a2f32c-0ec4-442a-9b47-117326581c48 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:14.119897 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f6a2f32c-0ec4-442a-9b47-117326581c48 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1750 microversion: 2.20 time: 1.061224 Jan 28 00:55:14.133099 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d7b06e5f-58fd-4b7f-93bd-bc6c9f91a738 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:14.134933 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 250/523] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:13 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1750 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:55:14.141776 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-714aedab-2bad-4d6a-91c1-4ca970b8a016 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:14.142456 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-714aedab-2bad-4d6a-91c1-4ca970b8a016 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:14.144812 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d7b06e5f-58fd-4b7f-93bd-bc6c9f91a738 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1453 microversion: 2.1 time: 1.103701 Jan 28 00:55:14.146049 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 274/524] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:13 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1453 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:14.150732 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-714aedab-2bad-4d6a-91c1-4ca970b8a016 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:14.155431 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-714aedab-2bad-4d6a-91c1-4ca970b8a016 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:14.156142 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-714aedab-2bad-4d6a-91c1-4ca970b8a016 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:14.156690 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-714aedab-2bad-4d6a-91c1-4ca970b8a016 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:14.175525 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-14b9e621-8837-48d2-9dff-aa8693669fd5 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:14.176816 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-14b9e621-8837-48d2-9dff-aa8693669fd5 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:14.190617 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-14b9e621-8837-48d2-9dff-aa8693669fd5 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:14.191639 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-14b9e621-8837-48d2-9dff-aa8693669fd5 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:14.193221 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-14b9e621-8837-48d2-9dff-aa8693669fd5 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:14.194146 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-14b9e621-8837-48d2-9dff-aa8693669fd5 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:14.565384 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-714aedab-2bad-4d6a-91c1-4ca970b8a016 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:14.576605 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-714aedab-2bad-4d6a-91c1-4ca970b8a016 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.439298 Jan 28 00:55:14.578224 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 251/525] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:14 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:14.602846 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-14b9e621-8837-48d2-9dff-aa8693669fd5 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:14.618106 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-14b9e621-8837-48d2-9dff-aa8693669fd5 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1453 microversion: 2.1 time: 0.450419 Jan 28 00:55:14.619643 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 275/526] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:14 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1453 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:15.159250 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c0db91c7-43b1-40a9-8368-dbde94a36359 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:15.160739 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c0db91c7-43b1-40a9-8368-dbde94a36359 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:15.174101 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c0db91c7-43b1-40a9-8368-dbde94a36359 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:15.175080 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c0db91c7-43b1-40a9-8368-dbde94a36359 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:15.176151 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c0db91c7-43b1-40a9-8368-dbde94a36359 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:15.177488 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c0db91c7-43b1-40a9-8368-dbde94a36359 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:15.584996 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-c0db91c7-43b1-40a9-8368-dbde94a36359 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:15.597136 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-c0db91c7-43b1-40a9-8368-dbde94a36359 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:15.607960 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-c0db91c7-43b1-40a9-8368-dbde94a36359 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:15.610556 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c0db91c7-43b1-40a9-8368-dbde94a36359 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1750 microversion: 2.20 time: 0.464388 Jan 28 00:55:15.611291 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-593ffa8d-4d2e-41fd-8685-f89354e1e1f4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:15.615023 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-593ffa8d-4d2e-41fd-8685-f89354e1e1f4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:15.617408 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 252/527] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:15 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1750 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:15.638773 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-593ffa8d-4d2e-41fd-8685-f89354e1e1f4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:15.639987 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-593ffa8d-4d2e-41fd-8685-f89354e1e1f4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:15.644635 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-593ffa8d-4d2e-41fd-8685-f89354e1e1f4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:15.645254 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-593ffa8d-4d2e-41fd-8685-f89354e1e1f4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:15.988881 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-593ffa8d-4d2e-41fd-8685-f89354e1e1f4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:16.006106 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-593ffa8d-4d2e-41fd-8685-f89354e1e1f4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.402813 Jan 28 00:55:16.020084 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 276/528] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:15 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:16.646965 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-49ac31f6-00df-44fe-8594-f13ca9f11714 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:16.654009 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-49ac31f6-00df-44fe-8594-f13ca9f11714 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:16.677711 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-49ac31f6-00df-44fe-8594-f13ca9f11714 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:16.678551 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-49ac31f6-00df-44fe-8594-f13ca9f11714 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:16.680070 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-49ac31f6-00df-44fe-8594-f13ca9f11714 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:16.681830 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-49ac31f6-00df-44fe-8594-f13ca9f11714 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:17.035412 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-309feebf-b758-4e48-afef-e4a3e9d701da tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:17.036267 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-309feebf-b758-4e48-afef-e4a3e9d701da tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:17.050935 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-309feebf-b758-4e48-afef-e4a3e9d701da tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:17.063023 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-309feebf-b758-4e48-afef-e4a3e9d701da tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:17.065784 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-309feebf-b758-4e48-afef-e4a3e9d701da tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:17.072926 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-309feebf-b758-4e48-afef-e4a3e9d701da tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:17.112688 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-49ac31f6-00df-44fe-8594-f13ca9f11714 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:17.166715 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-49ac31f6-00df-44fe-8594-f13ca9f11714 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:17.177915 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-49ac31f6-00df-44fe-8594-f13ca9f11714 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:17.199072 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-49ac31f6-00df-44fe-8594-f13ca9f11714 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1750 microversion: 2.20 time: 0.556559 Jan 28 00:55:17.212004 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 253/529] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:16 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1750 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:17.521021 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-309feebf-b758-4e48-afef-e4a3e9d701da tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:17.543891 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-309feebf-b758-4e48-afef-e4a3e9d701da tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.512557 Jan 28 00:55:17.559191 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 277/530] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:17 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:18.098228 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c71afb1f-bb53-4d07-8e26-0aa996abfb17 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:18.105388 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c71afb1f-bb53-4d07-8e26-0aa996abfb17 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:18.148142 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c71afb1f-bb53-4d07-8e26-0aa996abfb17 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:18.151143 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c71afb1f-bb53-4d07-8e26-0aa996abfb17 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:18.160148 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c71afb1f-bb53-4d07-8e26-0aa996abfb17 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:18.164720 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c71afb1f-bb53-4d07-8e26-0aa996abfb17 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:18.224008 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9258b506-3711-44b2-84ac-73ced52930ba tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:18.225187 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9258b506-3711-44b2-84ac-73ced52930ba tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:18.257136 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9258b506-3711-44b2-84ac-73ced52930ba tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:18.258328 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9258b506-3711-44b2-84ac-73ced52930ba tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:18.263100 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9258b506-3711-44b2-84ac-73ced52930ba tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:18.264990 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9258b506-3711-44b2-84ac-73ced52930ba tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:18.303365 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c71afb1f-bb53-4d07-8e26-0aa996abfb17 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Going to try to terminate instance {{(pid=127863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 00:55:18.520088 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c71afb1f-bb53-4d07-8e26-0aa996abfb17 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "DELETE /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 204 len: 0 microversion: 2.1 time: 0.430807 Jan 28 00:55:18.521436 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 254/531] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 00:55:18 2022] DELETE /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 00:55:18.533663 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4ac29de8-8351-4fa2-9217-15cd5d07c8c1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:18.534881 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4ac29de8-8351-4fa2-9217-15cd5d07c8c1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:18.550315 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4ac29de8-8351-4fa2-9217-15cd5d07c8c1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:18.550520 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4ac29de8-8351-4fa2-9217-15cd5d07c8c1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:18.551369 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4ac29de8-8351-4fa2-9217-15cd5d07c8c1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:18.551791 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4ac29de8-8351-4fa2-9217-15cd5d07c8c1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:18.959475 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9258b506-3711-44b2-84ac-73ced52930ba tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:18.996729 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9258b506-3711-44b2-84ac-73ced52930ba tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:19.018130 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9258b506-3711-44b2-84ac-73ced52930ba tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:19.041151 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9258b506-3711-44b2-84ac-73ced52930ba tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1750 microversion: 2.20 time: 0.823625 Jan 28 00:55:19.084001 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 278/532] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:18 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1750 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:19.120937 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-918ce741-23ef-4c95-ab08-8538a33485f2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:19.129119 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-918ce741-23ef-4c95-ab08-8538a33485f2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:19.179993 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-918ce741-23ef-4c95-ab08-8538a33485f2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:19.181465 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-918ce741-23ef-4c95-ab08-8538a33485f2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:19.187777 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-918ce741-23ef-4c95-ab08-8538a33485f2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:19.188266 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-918ce741-23ef-4c95-ab08-8538a33485f2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:19.306397 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4ac29de8-8351-4fa2-9217-15cd5d07c8c1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:19.315182 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4ac29de8-8351-4fa2-9217-15cd5d07c8c1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1506 microversion: 2.1 time: 0.787838 Jan 28 00:55:19.315798 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 255/533] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:18 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1506 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:19.573771 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-918ce741-23ef-4c95-ab08-8538a33485f2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:19.606092 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-918ce741-23ef-4c95-ab08-8538a33485f2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.519703 Jan 28 00:55:19.609146 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 279/534] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:19 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:20.091253 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f783bfdc-92bc-4309-b03b-c3ecf607b913 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:20.096146 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f783bfdc-92bc-4309-b03b-c3ecf607b913 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:20.118535 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f783bfdc-92bc-4309-b03b-c3ecf607b913 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:20.119510 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f783bfdc-92bc-4309-b03b-c3ecf607b913 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:20.129075 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f783bfdc-92bc-4309-b03b-c3ecf607b913 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:20.129929 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f783bfdc-92bc-4309-b03b-c3ecf607b913 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:20.342275 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-228011b0-f4c6-4e26-824e-161960d6151d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:20.343691 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-228011b0-f4c6-4e26-824e-161960d6151d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:20.362560 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-228011b0-f4c6-4e26-824e-161960d6151d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:20.363739 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-228011b0-f4c6-4e26-824e-161960d6151d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:20.365330 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-228011b0-f4c6-4e26-824e-161960d6151d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:20.366411 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-228011b0-f4c6-4e26-824e-161960d6151d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:20.480819 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f783bfdc-92bc-4309-b03b-c3ecf607b913 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:20.502979 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f783bfdc-92bc-4309-b03b-c3ecf607b913 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:20.504972 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f783bfdc-92bc-4309-b03b-c3ecf607b913 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:20.506439 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f783bfdc-92bc-4309-b03b-c3ecf607b913 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1750 microversion: 2.20 time: 0.422822 Jan 28 00:55:20.519508 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 256/535] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:20 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1750 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:20.631850 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ab228b4e-c478-4b0a-a56c-e9d052da8a33 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:20.634722 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ab228b4e-c478-4b0a-a56c-e9d052da8a33 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:20.651809 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ab228b4e-c478-4b0a-a56c-e9d052da8a33 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:20.654197 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ab228b4e-c478-4b0a-a56c-e9d052da8a33 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:20.660543 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ab228b4e-c478-4b0a-a56c-e9d052da8a33 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:20.661913 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ab228b4e-c478-4b0a-a56c-e9d052da8a33 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:20.764974 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-228011b0-f4c6-4e26-824e-161960d6151d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:20.777541 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-228011b0-f4c6-4e26-824e-161960d6151d tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1506 microversion: 2.1 time: 0.439240 Jan 28 00:55:20.782230 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 280/536] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:20 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1506 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:21.011379 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-ab228b4e-c478-4b0a-a56c-e9d052da8a33 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:21.030102 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ab228b4e-c478-4b0a-a56c-e9d052da8a33 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.402828 Jan 28 00:55:21.031661 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 257/537] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:20 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:21.302307 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-91ebdaaa-24e3-4330-8329-b12d2d304605 req-5808c142-ab99-4607-9328-6cbf71e0f389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad5a37e9-9762-4d3f-9756-97f267719f8c", "tag": "ddcf3686-7e23-4e79-8ec0-b709d910fa59"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:55:21.305693 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:55:21.305693 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:55:21.315957 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-91ebdaaa-24e3-4330-8329-b12d2d304605 req-5808c142-ab99-4607-9328-6cbf71e0f389 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:21.316792 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-91ebdaaa-24e3-4330-8329-b12d2d304605 req-5808c142-ab99-4607-9328-6cbf71e0f389 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:21.330300 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-91ebdaaa-24e3-4330-8329-b12d2d304605 req-5808c142-ab99-4607-9328-6cbf71e0f389 service nova] Creating event network-changed:ddcf3686-7e23-4e79-8ec0-b709d910fa59 for instance ad5a37e9-9762-4d3f-9756-97f267719f8c on hv-cinder-80952 Jan 28 00:55:21.341078 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-91ebdaaa-24e3-4330-8329-b12d2d304605 req-5808c142-ab99-4607-9328-6cbf71e0f389 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042270 Jan 28 00:55:21.342198 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 281/538] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:55:21.544525 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1e970688-b6d0-49af-8446-ae134f677322 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:21.545127 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-1e970688-b6d0-49af-8446-ae134f677322 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:21.574629 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1e970688-b6d0-49af-8446-ae134f677322 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:21.578922 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1e970688-b6d0-49af-8446-ae134f677322 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:21.585833 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1e970688-b6d0-49af-8446-ae134f677322 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:21.587565 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1e970688-b6d0-49af-8446-ae134f677322 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:21.599534 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-79379cce-7fcc-4e9e-9238-64bde72d686a tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:21.600126 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-79379cce-7fcc-4e9e-9238-64bde72d686a tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:21.618944 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-79379cce-7fcc-4e9e-9238-64bde72d686a tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:21.619628 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-79379cce-7fcc-4e9e-9238-64bde72d686a tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:21.620496 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-79379cce-7fcc-4e9e-9238-64bde72d686a tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:21.620946 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-79379cce-7fcc-4e9e-9238-64bde72d686a tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:21.867238 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.objects.instance [None req-79379cce-7fcc-4e9e-9238-64bde72d686a tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lazy-loading 'services' on Instance uuid 76e5f89a-038f-425a-b008-62c40c04e4ee {{(pid=127862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:55:22.051945 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-1e970688-b6d0-49af-8446-ae134f677322 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:22.087175 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-1e970688-b6d0-49af-8446-ae134f677322 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:22.091132 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-79379cce-7fcc-4e9e-9238-64bde72d686a tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "DELETE /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee/os-volume_attachments/34273b81-6961-4cde-940a-99a78deb537c" status: 202 len: 0 microversion: 2.1 time: 0.496672 Jan 28 00:55:22.092971 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-1e970688-b6d0-49af-8446-ae134f677322 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:22.094819 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1e970688-b6d0-49af-8446-ae134f677322 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1750 microversion: 2.20 time: 0.561376 Jan 28 00:55:22.106420 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 282/539] 10.222.0.25 () {58 vars in 1415 bytes} [Fri Jan 28 00:55:21 2022] DELETE /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee/os-volume_attachments/34273b81-6961-4cde-940a-99a78deb537c => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:55:22.118667 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 258/540] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:21 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1750 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:22.129227 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f2f7c193-bc46-4736-a1f6-f1bfc1ba1ab8 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:22.130416 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f2f7c193-bc46-4736-a1f6-f1bfc1ba1ab8 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:22.141808 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-abead893-cdb3-4596-b53b-597fe1a64cb2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:22.150432 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f2f7c193-bc46-4736-a1f6-f1bfc1ba1ab8 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:22.150881 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f2f7c193-bc46-4736-a1f6-f1bfc1ba1ab8 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:22.151925 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f2f7c193-bc46-4736-a1f6-f1bfc1ba1ab8 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:22.156359 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f2f7c193-bc46-4736-a1f6-f1bfc1ba1ab8 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:22.158981 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-abead893-cdb3-4596-b53b-597fe1a64cb2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:22.181453 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-abead893-cdb3-4596-b53b-597fe1a64cb2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:22.183169 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-abead893-cdb3-4596-b53b-597fe1a64cb2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:22.195583 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-abead893-cdb3-4596-b53b-597fe1a64cb2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:22.196471 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-abead893-cdb3-4596-b53b-597fe1a64cb2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:22.529604 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f2f7c193-bc46-4736-a1f6-f1bfc1ba1ab8 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:22.540964 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f2f7c193-bc46-4736-a1f6-f1bfc1ba1ab8 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1506 microversion: 2.1 time: 0.432702 Jan 28 00:55:22.541567 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 283/541] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:22 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:22.726612 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-abead893-cdb3-4596-b53b-597fe1a64cb2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:22.741703 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-abead893-cdb3-4596-b53b-597fe1a64cb2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.620342 Jan 28 00:55:22.742917 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 259/542] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:22 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:23.153814 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-80c48774-5903-407e-bcf9-33b61d86cc40 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:23.155401 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-80c48774-5903-407e-bcf9-33b61d86cc40 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:23.169101 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-80c48774-5903-407e-bcf9-33b61d86cc40 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:23.175748 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-80c48774-5903-407e-bcf9-33b61d86cc40 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:23.176922 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-80c48774-5903-407e-bcf9-33b61d86cc40 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:23.177535 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-80c48774-5903-407e-bcf9-33b61d86cc40 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:23.562802 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-80c48774-5903-407e-bcf9-33b61d86cc40 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:23.563112 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f4c2c6f8-73fb-4b4b-8437-a1d6a7a4d68e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:23.564045 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f4c2c6f8-73fb-4b4b-8437-a1d6a7a4d68e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:23.585300 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f4c2c6f8-73fb-4b4b-8437-a1d6a7a4d68e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:23.591422 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-80c48774-5903-407e-bcf9-33b61d86cc40 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:23.594863 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f4c2c6f8-73fb-4b4b-8437-a1d6a7a4d68e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:23.599384 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f4c2c6f8-73fb-4b4b-8437-a1d6a7a4d68e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:23.600072 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f4c2c6f8-73fb-4b4b-8437-a1d6a7a4d68e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:23.607154 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-80c48774-5903-407e-bcf9-33b61d86cc40 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:23.610141 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-80c48774-5903-407e-bcf9-33b61d86cc40 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1750 microversion: 2.20 time: 0.460063 Jan 28 00:55:23.614062 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 284/543] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:23 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1750 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:55:23.766782 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-5c3982b9-a33e-4d98-be29-141ed86f9e61 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:23.767691 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-5c3982b9-a33e-4d98-be29-141ed86f9e61 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:23.802470 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5c3982b9-a33e-4d98-be29-141ed86f9e61 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:23.803083 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5c3982b9-a33e-4d98-be29-141ed86f9e61 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:23.804703 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5c3982b9-a33e-4d98-be29-141ed86f9e61 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:23.809425 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5c3982b9-a33e-4d98-be29-141ed86f9e61 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:24.274602 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f4c2c6f8-73fb-4b4b-8437-a1d6a7a4d68e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:24.282767 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f4c2c6f8-73fb-4b4b-8437-a1d6a7a4d68e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1506 microversion: 2.1 time: 0.727816 Jan 28 00:55:24.291647 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 260/544] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:23 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1506 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:24.393586 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-423de663-6368-415e-bcc1-7f75887ac0bb req-04205de2-8a0d-4a2e-a6cb-d2a870c28441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e", "name": "network-vif-deleted", "tag": "e865b513-e08e-40ae-b53a-9cc6744e4709"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:55:24.409787 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:55:24.409787 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:55:24.449225 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-5c3982b9-a33e-4d98-be29-141ed86f9e61 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:24.455695 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-423de663-6368-415e-bcc1-7f75887ac0bb req-04205de2-8a0d-4a2e-a6cb-d2a870c28441 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:24.459180 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-423de663-6368-415e-bcc1-7f75887ac0bb req-04205de2-8a0d-4a2e-a6cb-d2a870c28441 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:24.463078 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-5c3982b9-a33e-4d98-be29-141ed86f9e61 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.704312 Jan 28 00:55:24.463699 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 285/545] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:23 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:24.491842 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9e416c7d-2758-4174-a163-87960b3abae8 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:24.496053 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9e416c7d-2758-4174-a163-87960b3abae8 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:24.509955 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9e416c7d-2758-4174-a163-87960b3abae8 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:24.510746 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9e416c7d-2758-4174-a163-87960b3abae8 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:24.512108 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9e416c7d-2758-4174-a163-87960b3abae8 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:24.520109 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9e416c7d-2758-4174-a163-87960b3abae8 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:24.522717 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-423de663-6368-415e-bcc1-7f75887ac0bb req-04205de2-8a0d-4a2e-a6cb-d2a870c28441 service nova] Creating event network-vif-deleted:e865b513-e08e-40ae-b53a-9cc6744e4709 for instance 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e on hv-cinder-80952 Jan 28 00:55:24.577522 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9e416c7d-2758-4174-a163-87960b3abae8 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Going to try to terminate instance {{(pid=127862) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 00:55:24.580602 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-423de663-6368-415e-bcc1-7f75887ac0bb req-04205de2-8a0d-4a2e-a6cb-d2a870c28441 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192510 Jan 28 00:55:24.584122 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 261/546] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:55:24.657610 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-95e187a3-2675-410f-ab35-befc04e384db tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:24.669455 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-95e187a3-2675-410f-ab35-befc04e384db tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:24.681714 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-95e187a3-2675-410f-ab35-befc04e384db tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:24.682804 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-95e187a3-2675-410f-ab35-befc04e384db tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:24.684374 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-95e187a3-2675-410f-ab35-befc04e384db tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:24.685448 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-95e187a3-2675-410f-ab35-befc04e384db tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:24.792842 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9e416c7d-2758-4174-a163-87960b3abae8 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "DELETE /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 204 len: 0 microversion: 2.1 time: 0.305560 Jan 28 00:55:24.794309 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 286/547] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 00:55:24 2022] DELETE /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 00:55:24.803666 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-b8af6f8d-c3e1-4f6e-a91d-e3db091def03 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:24.804577 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-b8af6f8d-c3e1-4f6e-a91d-e3db091def03 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:24.826477 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b8af6f8d-c3e1-4f6e-a91d-e3db091def03 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:24.827519 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b8af6f8d-c3e1-4f6e-a91d-e3db091def03 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:24.828686 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b8af6f8d-c3e1-4f6e-a91d-e3db091def03 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:24.829323 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b8af6f8d-c3e1-4f6e-a91d-e3db091def03 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:25.097950 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-95e187a3-2675-410f-ab35-befc04e384db tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:25.115117 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-95e187a3-2675-410f-ab35-befc04e384db tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:25.117357 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-95e187a3-2675-410f-ab35-befc04e384db tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:25.128884 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-95e187a3-2675-410f-ab35-befc04e384db tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1750 microversion: 2.20 time: 0.485438 Jan 28 00:55:25.129784 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 262/548] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:24 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1750 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:25.160766 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-b8af6f8d-c3e1-4f6e-a91d-e3db091def03 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:25.175628 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-b8af6f8d-c3e1-4f6e-a91d-e3db091def03 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 200 len: 1514 microversion: 2.1 time: 0.376249 Jan 28 00:55:25.176571 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 287/549] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:24 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 1514 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:25.301542 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4134d9e5-c755-46fa-b05e-f98b6e6dafd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:25.303000 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4134d9e5-c755-46fa-b05e-f98b6e6dafd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:25.327878 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4134d9e5-c755-46fa-b05e-f98b6e6dafd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:25.336202 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4134d9e5-c755-46fa-b05e-f98b6e6dafd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:25.339462 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4134d9e5-c755-46fa-b05e-f98b6e6dafd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:25.340132 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4134d9e5-c755-46fa-b05e-f98b6e6dafd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:25.491595 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-543c8c90-e059-41c3-8a8a-599578e7c8d1 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:25.492987 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-543c8c90-e059-41c3-8a8a-599578e7c8d1 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:25.540446 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-543c8c90-e059-41c3-8a8a-599578e7c8d1 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:25.545051 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-543c8c90-e059-41c3-8a8a-599578e7c8d1 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:25.556491 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-543c8c90-e059-41c3-8a8a-599578e7c8d1 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:25.563282 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-543c8c90-e059-41c3-8a8a-599578e7c8d1 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:25.579033 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4134d9e5-c755-46fa-b05e-f98b6e6dafd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:25.580216 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4134d9e5-c755-46fa-b05e-f98b6e6dafd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:25.584564 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.objects.instance [None req-4134d9e5-c755-46fa-b05e-f98b6e6dafd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lazy-loading 'fault' on Instance uuid 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e {{(pid=127863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:55:25.828963 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4134d9e5-c755-46fa-b05e-f98b6e6dafd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:25.841032 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4134d9e5-c755-46fa-b05e-f98b6e6dafd1 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 200 len: 1311 microversion: 2.1 time: 0.541009 Jan 28 00:55:25.841785 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 263/550] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:25 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 1311 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:25.970465 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-543c8c90-e059-41c3-8a8a-599578e7c8d1 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:25.985340 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-543c8c90-e059-41c3-8a8a-599578e7c8d1 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.500151 Jan 28 00:55:25.986696 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 288/551] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:25 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:26.150036 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-31c2330a-03e7-476c-8247-e3d5a6c95a9f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:26.150928 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-31c2330a-03e7-476c-8247-e3d5a6c95a9f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:26.158527 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-31c2330a-03e7-476c-8247-e3d5a6c95a9f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:26.159309 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-31c2330a-03e7-476c-8247-e3d5a6c95a9f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:26.160298 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-31c2330a-03e7-476c-8247-e3d5a6c95a9f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:26.160924 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-31c2330a-03e7-476c-8247-e3d5a6c95a9f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:26.199789 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4cc56ce7-d998-4c4a-b301-81a1e2f72441 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:26.200732 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4cc56ce7-d998-4c4a-b301-81a1e2f72441 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:26.233600 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4cc56ce7-d998-4c4a-b301-81a1e2f72441 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:26.234470 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4cc56ce7-d998-4c4a-b301-81a1e2f72441 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:26.235505 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4cc56ce7-d998-4c4a-b301-81a1e2f72441 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:26.236114 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4cc56ce7-d998-4c4a-b301-81a1e2f72441 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:26.405521 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-31c2330a-03e7-476c-8247-e3d5a6c95a9f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:26.415790 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-31c2330a-03e7-476c-8247-e3d5a6c95a9f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:26.417293 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-31c2330a-03e7-476c-8247-e3d5a6c95a9f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:26.419188 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-31c2330a-03e7-476c-8247-e3d5a6c95a9f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1750 microversion: 2.20 time: 0.273188 Jan 28 00:55:26.431724 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 264/552] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:26 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1750 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:26.554300 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4cc56ce7-d998-4c4a-b301-81a1e2f72441 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:26.583097 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4cc56ce7-d998-4c4a-b301-81a1e2f72441 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 200 len: 1514 microversion: 2.1 time: 0.385196 Jan 28 00:55:26.584846 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 289/553] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:26 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 1514 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:26.864531 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f5ba651e-93b6-4cd6-b257-f97bd25b0256 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:26.865214 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f5ba651e-93b6-4cd6-b257-f97bd25b0256 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:26.887785 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f5ba651e-93b6-4cd6-b257-f97bd25b0256 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:26.888249 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f5ba651e-93b6-4cd6-b257-f97bd25b0256 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:26.890659 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f5ba651e-93b6-4cd6-b257-f97bd25b0256 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:26.892877 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f5ba651e-93b6-4cd6-b257-f97bd25b0256 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:26.912037 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-f5ba651e-93b6-4cd6-b257-f97bd25b0256 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] HTTP exception thrown: Instance 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e could not be found. Jan 28 00:55:26.913110 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f5ba651e-93b6-4cd6-b257-f97bd25b0256 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Returning 404 to user: Instance 427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:55:26.914128 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f5ba651e-93b6-4cd6-b257-f97bd25b0256 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e" status: 404 len: 111 microversion: 2.1 time: 0.057854 Jan 28 00:55:26.915188 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 265/554] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:26 2022] GET /compute/v2.1/servers/427c5ca5-5d7b-4cc5-ad8e-313a0ffbc04e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 00:55:26.924501 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4ade4c6d-78f6-4d86-a210-d783881fd94f tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:26.927049 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4ade4c6d-78f6-4d86-a210-d783881fd94f tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:26.935667 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4ade4c6d-78f6-4d86-a210-d783881fd94f tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:26.937752 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4ade4c6d-78f6-4d86-a210-d783881fd94f tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:26.939233 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4ade4c6d-78f6-4d86-a210-d783881fd94f tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:26.939897 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4ade4c6d-78f6-4d86-a210-d783881fd94f tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:26.983819 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4ade4c6d-78f6-4d86-a210-d783881fd94f tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Going to try to terminate instance {{(pid=127862) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 00:55:27.006593 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1e38d3fb-ca87-49b0-a7db-2842531c07d5 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:27.007214 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-1e38d3fb-ca87-49b0-a7db-2842531c07d5 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:27.022771 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1e38d3fb-ca87-49b0-a7db-2842531c07d5 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:27.023238 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1e38d3fb-ca87-49b0-a7db-2842531c07d5 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:27.026729 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1e38d3fb-ca87-49b0-a7db-2842531c07d5 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:27.027202 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1e38d3fb-ca87-49b0-a7db-2842531c07d5 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:27.169475 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4ade4c6d-78f6-4d86-a210-d783881fd94f tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "DELETE /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 204 len: 0 microversion: 2.1 time: 0.247730 Jan 28 00:55:27.173119 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 290/555] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 00:55:26 2022] DELETE /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 00:55:27.199988 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-b1c98aa5-b35e-49a6-8a0b-3e8014d731d5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:27.202646 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-b1c98aa5-b35e-49a6-8a0b-3e8014d731d5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:27.217076 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b1c98aa5-b35e-49a6-8a0b-3e8014d731d5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:27.222863 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b1c98aa5-b35e-49a6-8a0b-3e8014d731d5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:27.226951 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b1c98aa5-b35e-49a6-8a0b-3e8014d731d5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:27.227735 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b1c98aa5-b35e-49a6-8a0b-3e8014d731d5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:27.461749 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-1e38d3fb-ca87-49b0-a7db-2842531c07d5 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:27.483916 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1e38d3fb-ca87-49b0-a7db-2842531c07d5 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.476618 Jan 28 00:55:27.485124 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 266/556] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:27 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:27.503234 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-38f5027d-d184-42dd-b597-d19c0116c631 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:27.503903 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-38f5027d-d184-42dd-b597-d19c0116c631 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:27.515825 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-38f5027d-d184-42dd-b597-d19c0116c631 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:27.516282 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-38f5027d-d184-42dd-b597-d19c0116c631 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:27.517100 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-38f5027d-d184-42dd-b597-d19c0116c631 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:27.517712 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-38f5027d-d184-42dd-b597-d19c0116c631 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:27.582444 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-b1c98aa5-b35e-49a6-8a0b-3e8014d731d5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:27.597959 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-b1c98aa5-b35e-49a6-8a0b-3e8014d731d5 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.418179 Jan 28 00:55:27.611674 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 291/557] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:27 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:27.630996 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-bc6d44bc-6608-4e18-83df-4730c62fe296 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:27.633574 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-bc6d44bc-6608-4e18-83df-4730c62fe296 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:27.648083 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bc6d44bc-6608-4e18-83df-4730c62fe296 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:27.650608 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bc6d44bc-6608-4e18-83df-4730c62fe296 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:27.651666 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bc6d44bc-6608-4e18-83df-4730c62fe296 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:27.666562 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bc6d44bc-6608-4e18-83df-4730c62fe296 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:27.759927 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-38f5027d-d184-42dd-b597-d19c0116c631 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:27.776920 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-38f5027d-d184-42dd-b597-d19c0116c631 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:27.776920 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-38f5027d-d184-42dd-b597-d19c0116c631 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:27.786676 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-38f5027d-d184-42dd-b597-d19c0116c631 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1750 microversion: 2.20 time: 0.287896 Jan 28 00:55:27.788548 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 267/558] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:27 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1750 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:27.806899 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e3b09974-baee-44e0-a881-606bf242e3f9 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Action: 'create', calling method: .version_select at 0x7fbbc230ee50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1940911014"}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:55:27.847923 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-e3b09974-baee-44e0-a881-606bf242e3f9 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Getting quotas for project 2dc8dc67a706412e8404052725053540. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:55:27.854196 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-e3b09974-baee-44e0-a881-606bf242e3f9 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Getting quotas for user bdc05aaccb634ca3bd0a3549333cd06d and project 2dc8dc67a706412e8404052725053540. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:55:28.013892 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-bc6d44bc-6608-4e18-83df-4730c62fe296 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:28.027084 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-bc6d44bc-6608-4e18-83df-4730c62fe296 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 200 len: 1514 microversion: 2.1 time: 0.413980 Jan 28 00:55:28.028521 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 292/559] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:27 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 1514 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:28.242075 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-e3b09974-baee-44e0-a881-606bf242e3f9 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Getting quotas for project 2dc8dc67a706412e8404052725053540. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:55:28.247717 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-e3b09974-baee-44e0-a881-606bf242e3f9 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Getting quotas for user bdc05aaccb634ca3bd0a3549333cd06d and project 2dc8dc67a706412e8404052725053540. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:55:28.269008 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e3b09974-baee-44e0-a881-606bf242e3f9 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.473327 Jan 28 00:55:28.270621 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 268/560] 10.222.0.25 () {60 vars in 1157 bytes} [Fri Jan 28 00:55:27 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:28.355316 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-08efebda-bdbf-4d57-b00b-aa94abe1c1fe tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-343017762", "imageRef": "d11c0e11-bf97-473f-a478-05cddf01ef9d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1940911014", "networks": [{"uuid": "39577bfa-3fba-4a70-a43b-f0533785c33e"}]}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:55:28.428500 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.network.neutron [None req-08efebda-bdbf-4d57-b00b-aa94abe1c1fe tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] validate_networks() for [('39577bfa-3fba-4a70-a43b-f0533785c33e', None, None, None, None, None)] {{(pid=127862) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:55:28.516127 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2f5b877e-9a65-4a66-ad21-352eef6ee9f6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:28.518020 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2f5b877e-9a65-4a66-ad21-352eef6ee9f6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:28.528223 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2f5b877e-9a65-4a66-ad21-352eef6ee9f6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:28.529338 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2f5b877e-9a65-4a66-ad21-352eef6ee9f6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:28.530358 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2f5b877e-9a65-4a66-ad21-352eef6ee9f6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:28.531096 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2f5b877e-9a65-4a66-ad21-352eef6ee9f6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:28.790641 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-2f5b877e-9a65-4a66-ad21-352eef6ee9f6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:28.802727 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2f5b877e-9a65-4a66-ad21-352eef6ee9f6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.299770 Jan 28 00:55:28.803928 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 269/561] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:28 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:28.810011 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-236f17b3-f337-4c34-9996-59a921a90b7b req-b4b20fa1-e504-4ba5-aa50-29093515fe1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76e5f89a-038f-425a-b008-62c40c04e4ee", "name": "network-vif-deleted", "tag": "0198106c-9759-4527-a8ac-7d224d22beb2"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:55:28.813176 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:55:28.813176 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:55:28.821078 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-236f17b3-f337-4c34-9996-59a921a90b7b req-b4b20fa1-e504-4ba5-aa50-29093515fe1e service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:28.821680 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-236f17b3-f337-4c34-9996-59a921a90b7b req-b4b20fa1-e504-4ba5-aa50-29093515fe1e service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:28.843826 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-236f17b3-f337-4c34-9996-59a921a90b7b req-b4b20fa1-e504-4ba5-aa50-29093515fe1e service nova] Creating event network-vif-deleted:0198106c-9759-4527-a8ac-7d224d22beb2 for instance 76e5f89a-038f-425a-b008-62c40c04e4ee on hv-cinder-80952 Jan 28 00:55:28.852929 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-236f17b3-f337-4c34-9996-59a921a90b7b req-b4b20fa1-e504-4ba5-aa50-29093515fe1e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046490 Jan 28 00:55:28.854041 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 270/562] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:55:28.864265 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-76f3f019-edaf-4e2b-bee5-9525afb62be3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:28.865348 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-76f3f019-edaf-4e2b-bee5-9525afb62be3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:28.872028 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-76f3f019-edaf-4e2b-bee5-9525afb62be3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:28.872544 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-76f3f019-edaf-4e2b-bee5-9525afb62be3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:28.873305 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-76f3f019-edaf-4e2b-bee5-9525afb62be3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:28.874337 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-76f3f019-edaf-4e2b-bee5-9525afb62be3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:29.130778 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-76f3f019-edaf-4e2b-bee5-9525afb62be3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:29.145877 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-76f3f019-edaf-4e2b-bee5-9525afb62be3 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.289630 Jan 28 00:55:29.162946 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 271/563] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:28 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:29.163679 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-08efebda-bdbf-4d57-b00b-aa94abe1c1fe tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Flavor limits 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:55:29.163679 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-08efebda-bdbf-4d57-b00b-aa94abe1c1fe tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Image limits 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:55:29.163679 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-08efebda-bdbf-4d57-b00b-aa94abe1c1fe tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Flavor pref 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:55:29.164695 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-08efebda-bdbf-4d57-b00b-aa94abe1c1fe tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Image pref 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:55:29.164858 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b2b3269d-a0ec-435d-971c-f215239e4efd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:29.165027 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-08efebda-bdbf-4d57-b00b-aa94abe1c1fe tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:55:29.165197 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b2b3269d-a0ec-435d-971c-f215239e4efd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:29.176575 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b2b3269d-a0ec-435d-971c-f215239e4efd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:29.177364 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b2b3269d-a0ec-435d-971c-f215239e4efd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:29.177994 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-08efebda-bdbf-4d57-b00b-aa94abe1c1fe tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:29.178563 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-08efebda-bdbf-4d57-b00b-aa94abe1c1fe tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:29.179018 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b2b3269d-a0ec-435d-971c-f215239e4efd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:29.179660 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-08efebda-bdbf-4d57-b00b-aa94abe1c1fe tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:29.179862 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b2b3269d-a0ec-435d-971c-f215239e4efd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:29.180320 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-08efebda-bdbf-4d57-b00b-aa94abe1c1fe tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:29.204339 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-08efebda-bdbf-4d57-b00b-aa94abe1c1fe tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Getting quotas for project 2dc8dc67a706412e8404052725053540. Resources: {'instances', 'cores', 'ram'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:55:29.209679 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-08efebda-bdbf-4d57-b00b-aa94abe1c1fe tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Getting quotas for user bdc05aaccb634ca3bd0a3549333cd06d and project 2dc8dc67a706412e8404052725053540. Resources: {'instances', 'cores', 'ram'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:55:29.224301 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-08efebda-bdbf-4d57-b00b-aa94abe1c1fe tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Going to run 1 instances... {{(pid=127862) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:55:29.226997 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-08efebda-bdbf-4d57-b00b-aa94abe1c1fe tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d11c0e11-bf97-473f-a478-05cddf01ef9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:55:29.301965 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-08efebda-bdbf-4d57-b00b-aa94abe1c1fe tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.950135 Jan 28 00:55:29.309417 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 293/564] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 00:55:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 00:55:29.338206 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4a31c5df-2cde-4611-8b2a-0adf4df4739b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:29.339331 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4a31c5df-2cde-4611-8b2a-0adf4df4739b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:29.352323 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4a31c5df-2cde-4611-8b2a-0adf4df4739b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:29.355205 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4a31c5df-2cde-4611-8b2a-0adf4df4739b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:29.358927 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4a31c5df-2cde-4611-8b2a-0adf4df4739b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:29.361125 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4a31c5df-2cde-4611-8b2a-0adf4df4739b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:29.411505 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4a31c5df-2cde-4611-8b2a-0adf4df4739b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:29.412166 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4a31c5df-2cde-4611-8b2a-0adf4df4739b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:29.412783 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.objects.instance [None req-4a31c5df-2cde-4611-8b2a-0adf4df4739b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lazy-loading 'fault' on Instance uuid 76e5f89a-038f-425a-b008-62c40c04e4ee {{(pid=127862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:55:29.504896 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4a31c5df-2cde-4611-8b2a-0adf4df4739b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba8966bcdbbc4e2e8d21a7a917c54108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88c2482fcb9c4c6197bf49eb103a1623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:29.515125 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4a31c5df-2cde-4611-8b2a-0adf4df4739b tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 200 len: 1308 microversion: 2.1 time: 0.201289 Jan 28 00:55:29.516149 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 294/565] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:29 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 1308 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:29.520949 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-08a2ae76-02ed-44d4-b6f3-460c1aa3350d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:29.521773 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-08a2ae76-02ed-44d4-b6f3-460c1aa3350d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:29.526393 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b2b3269d-a0ec-435d-971c-f215239e4efd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:29.537497 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b2b3269d-a0ec-435d-971c-f215239e4efd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:29.539742 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b2b3269d-a0ec-435d-971c-f215239e4efd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:29.541115 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b2b3269d-a0ec-435d-971c-f215239e4efd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1752 microversion: 2.20 time: 0.382499 Jan 28 00:55:29.557209 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 272/566] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:29 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1752 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:29.614426 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-08a2ae76-02ed-44d4-b6f3-460c1aa3350d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:29.634322 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-08a2ae76-02ed-44d4-b6f3-460c1aa3350d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1258 microversion: 2.1 time: 0.116611 Jan 28 00:55:29.635441 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 295/567] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:29 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1258 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:29.827701 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-38295848-7346-4cfe-ab9f-f65ca84b7e12 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:29.828507 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-38295848-7346-4cfe-ab9f-f65ca84b7e12 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:29.839469 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-38295848-7346-4cfe-ab9f-f65ca84b7e12 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:29.840316 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-38295848-7346-4cfe-ab9f-f65ca84b7e12 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:29.841482 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-38295848-7346-4cfe-ab9f-f65ca84b7e12 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:29.841996 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-38295848-7346-4cfe-ab9f-f65ca84b7e12 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:30.032171 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-38295848-7346-4cfe-ab9f-f65ca84b7e12 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:30.041892 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-38295848-7346-4cfe-ab9f-f65ca84b7e12 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.218035 Jan 28 00:55:30.042873 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 273/568] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:29 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:30.173308 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d69e7119-5bb8-4cdb-9500-8058fd1b0bec tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:30.174742 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d69e7119-5bb8-4cdb-9500-8058fd1b0bec tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:30.182430 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d69e7119-5bb8-4cdb-9500-8058fd1b0bec tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:30.182901 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d69e7119-5bb8-4cdb-9500-8058fd1b0bec tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:30.183776 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d69e7119-5bb8-4cdb-9500-8058fd1b0bec tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:30.184244 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d69e7119-5bb8-4cdb-9500-8058fd1b0bec tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:30.359748 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d69e7119-5bb8-4cdb-9500-8058fd1b0bec tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:30.370810 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d69e7119-5bb8-4cdb-9500-8058fd1b0bec tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.203128 Jan 28 00:55:30.371436 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 296/569] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:30 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:30.533684 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e8fca7ac-a87a-4838-9bed-cba3a4145398 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:30.534210 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e8fca7ac-a87a-4838-9bed-cba3a4145398 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] [instance: 76e5f89a-038f-425a-b008-62c40c04e4ee] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:30.540752 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e8fca7ac-a87a-4838-9bed-cba3a4145398 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:30.541208 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e8fca7ac-a87a-4838-9bed-cba3a4145398 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:30.542009 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e8fca7ac-a87a-4838-9bed-cba3a4145398 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:30.542448 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e8fca7ac-a87a-4838-9bed-cba3a4145398 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:30.557954 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-e8fca7ac-a87a-4838-9bed-cba3a4145398 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] HTTP exception thrown: Instance 76e5f89a-038f-425a-b008-62c40c04e4ee could not be found. Jan 28 00:55:30.558772 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e8fca7ac-a87a-4838-9bed-cba3a4145398 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] Returning 404 to user: Instance 76e5f89a-038f-425a-b008-62c40c04e4ee could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:55:30.559948 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e8fca7ac-a87a-4838-9bed-cba3a4145398 tempest-VolumesSnapshotTestJSON-933406303 tempest-VolumesSnapshotTestJSON-933406303-project] 10.222.0.25 "GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee" status: 404 len: 111 microversion: 2.1 time: 0.030698 Jan 28 00:55:30.560779 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 274/570] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:30 2022] GET /compute/v2.1/servers/76e5f89a-038f-425a-b008-62c40c04e4ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:55:30.563320 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-b5919851-d076-47ba-b17b-aad9850311b7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:30.563949 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-b5919851-d076-47ba-b17b-aad9850311b7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:30.571904 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b5919851-d076-47ba-b17b-aad9850311b7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:30.572496 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b5919851-d076-47ba-b17b-aad9850311b7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:30.573423 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b5919851-d076-47ba-b17b-aad9850311b7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:30.573877 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b5919851-d076-47ba-b17b-aad9850311b7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:30.666605 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2f8faad9-fc79-4a14-a74b-0ba17bdb3421 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:30.667608 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2f8faad9-fc79-4a14-a74b-0ba17bdb3421 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:30.676245 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2f8faad9-fc79-4a14-a74b-0ba17bdb3421 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:30.676390 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2f8faad9-fc79-4a14-a74b-0ba17bdb3421 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:30.677518 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2f8faad9-fc79-4a14-a74b-0ba17bdb3421 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:30.678309 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2f8faad9-fc79-4a14-a74b-0ba17bdb3421 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:30.772934 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-2f8faad9-fc79-4a14-a74b-0ba17bdb3421 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:30.775019 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-b5919851-d076-47ba-b17b-aad9850311b7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:30.789840 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-b5919851-d076-47ba-b17b-aad9850311b7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:30.792322 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-b5919851-d076-47ba-b17b-aad9850311b7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:30.794014 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-b5919851-d076-47ba-b17b-aad9850311b7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.235210 Jan 28 00:55:30.811511 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2f8faad9-fc79-4a14-a74b-0ba17bdb3421 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1310 microversion: 2.1 time: 0.135744 Jan 28 00:55:30.811511 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 275/571] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:30 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1310 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:30.815728 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 297/572] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:30 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:55:31.064602 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4b6e8627-e6ca-425f-a3f7-bb4da4358b79 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:31.066216 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4b6e8627-e6ca-425f-a3f7-bb4da4358b79 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:31.078633 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4b6e8627-e6ca-425f-a3f7-bb4da4358b79 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:31.079618 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4b6e8627-e6ca-425f-a3f7-bb4da4358b79 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:31.081187 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4b6e8627-e6ca-425f-a3f7-bb4da4358b79 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:31.082063 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4b6e8627-e6ca-425f-a3f7-bb4da4358b79 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:31.366304 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4b6e8627-e6ca-425f-a3f7-bb4da4358b79 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:31.378286 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4b6e8627-e6ca-425f-a3f7-bb4da4358b79 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.320839 Jan 28 00:55:31.391234 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 276/573] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:31 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:31.395690 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7d6ac8ff-d02d-404c-ae68-13b512bfc043 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:31.397235 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7d6ac8ff-d02d-404c-ae68-13b512bfc043 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:31.410744 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7d6ac8ff-d02d-404c-ae68-13b512bfc043 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:31.411995 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7d6ac8ff-d02d-404c-ae68-13b512bfc043 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:31.413682 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7d6ac8ff-d02d-404c-ae68-13b512bfc043 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:31.414461 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7d6ac8ff-d02d-404c-ae68-13b512bfc043 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:31.763974 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7d6ac8ff-d02d-404c-ae68-13b512bfc043 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:31.788033 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7d6ac8ff-d02d-404c-ae68-13b512bfc043 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.399709 Jan 28 00:55:31.789715 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 298/574] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:31 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:31.829336 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1345db4a-2dcc-47df-a11e-b57768c3038f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:31.830364 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1345db4a-2dcc-47df-a11e-b57768c3038f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:31.830930 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-88c6b84e-f09c-428e-a166-83bfd8c2d495 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:31.833099 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-88c6b84e-f09c-428e-a166-83bfd8c2d495 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:31.850290 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1345db4a-2dcc-47df-a11e-b57768c3038f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:31.860156 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1345db4a-2dcc-47df-a11e-b57768c3038f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:31.862561 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-88c6b84e-f09c-428e-a166-83bfd8c2d495 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:31.866466 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1345db4a-2dcc-47df-a11e-b57768c3038f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:31.867151 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1345db4a-2dcc-47df-a11e-b57768c3038f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:31.867988 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-88c6b84e-f09c-428e-a166-83bfd8c2d495 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:31.875914 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-88c6b84e-f09c-428e-a166-83bfd8c2d495 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:31.883672 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-88c6b84e-f09c-428e-a166-83bfd8c2d495 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:32.122465 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-88c6b84e-f09c-428e-a166-83bfd8c2d495 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:32.148935 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-88c6b84e-f09c-428e-a166-83bfd8c2d495 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1316 microversion: 2.1 time: 0.331372 Jan 28 00:55:32.151092 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 277/575] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:31 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1316 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:32.403149 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-34ec5516-8f7a-4f60-88b8-3d688c9c70b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:32.411535 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-34ec5516-8f7a-4f60-88b8-3d688c9c70b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:32.430955 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-1345db4a-2dcc-47df-a11e-b57768c3038f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:32.438874 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-34ec5516-8f7a-4f60-88b8-3d688c9c70b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:32.453301 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-34ec5516-8f7a-4f60-88b8-3d688c9c70b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:32.456813 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-1345db4a-2dcc-47df-a11e-b57768c3038f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:32.458507 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-34ec5516-8f7a-4f60-88b8-3d688c9c70b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:32.462073 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-34ec5516-8f7a-4f60-88b8-3d688c9c70b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:32.462641 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-1345db4a-2dcc-47df-a11e-b57768c3038f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:32.465270 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1345db4a-2dcc-47df-a11e-b57768c3038f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.642918 Jan 28 00:55:32.467102 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 299/576] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:31 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:55:32.806761 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9aa7e02b-2142-4b7a-9093-9fa04d8ca941 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:32.807422 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9aa7e02b-2142-4b7a-9093-9fa04d8ca941 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:32.822238 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9aa7e02b-2142-4b7a-9093-9fa04d8ca941 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:32.822704 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9aa7e02b-2142-4b7a-9093-9fa04d8ca941 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:32.823556 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9aa7e02b-2142-4b7a-9093-9fa04d8ca941 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:32.824007 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9aa7e02b-2142-4b7a-9093-9fa04d8ca941 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:33.077840 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-34ec5516-8f7a-4f60-88b8-3d688c9c70b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:33.094044 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-34ec5516-8f7a-4f60-88b8-3d688c9c70b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.698371 Jan 28 00:55:33.112950 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 278/577] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:32 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:33.175319 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7c835768-90ff-41f3-962b-6407e98a2e7d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:33.176220 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7c835768-90ff-41f3-962b-6407e98a2e7d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:33.196356 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7c835768-90ff-41f3-962b-6407e98a2e7d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:33.199878 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7c835768-90ff-41f3-962b-6407e98a2e7d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:33.202352 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7c835768-90ff-41f3-962b-6407e98a2e7d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:33.206383 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7c835768-90ff-41f3-962b-6407e98a2e7d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:33.372251 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9aa7e02b-2142-4b7a-9093-9fa04d8ca941 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:33.386140 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9aa7e02b-2142-4b7a-9093-9fa04d8ca941 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.583039 Jan 28 00:55:33.421097 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 300/578] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:32 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:33.498458 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-585e5f20-c9e1-4067-8f1c-2955b29d8abd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:33.499301 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-585e5f20-c9e1-4067-8f1c-2955b29d8abd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:33.514775 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-585e5f20-c9e1-4067-8f1c-2955b29d8abd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:33.515241 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-585e5f20-c9e1-4067-8f1c-2955b29d8abd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:33.516459 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-585e5f20-c9e1-4067-8f1c-2955b29d8abd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:33.516921 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-585e5f20-c9e1-4067-8f1c-2955b29d8abd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:33.550004 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7c835768-90ff-41f3-962b-6407e98a2e7d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:33.560242 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7c835768-90ff-41f3-962b-6407e98a2e7d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.390540 Jan 28 00:55:33.579667 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 279/579] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:33 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:33.958993 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-585e5f20-c9e1-4067-8f1c-2955b29d8abd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:33.984173 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-585e5f20-c9e1-4067-8f1c-2955b29d8abd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:33.999631 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-585e5f20-c9e1-4067-8f1c-2955b29d8abd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:34.008702 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-585e5f20-c9e1-4067-8f1c-2955b29d8abd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.513174 Jan 28 00:55:34.013614 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 301/580] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:33 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:34.121597 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c3cd76a6-4f6a-4e66-aace-5980c68c3423 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:34.122382 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c3cd76a6-4f6a-4e66-aace-5980c68c3423 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:34.132938 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c3cd76a6-4f6a-4e66-aace-5980c68c3423 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:34.133400 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c3cd76a6-4f6a-4e66-aace-5980c68c3423 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:34.134266 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c3cd76a6-4f6a-4e66-aace-5980c68c3423 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:34.134752 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c3cd76a6-4f6a-4e66-aace-5980c68c3423 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:34.351739 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-c3cd76a6-4f6a-4e66-aace-5980c68c3423 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:34.362761 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c3cd76a6-4f6a-4e66-aace-5980c68c3423 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.245430 Jan 28 00:55:34.363500 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 280/581] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:34 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:34.437058 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4466ef2d-8e70-431e-b20d-36db9ca0dbb2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:34.437675 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4466ef2d-8e70-431e-b20d-36db9ca0dbb2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:34.443807 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4466ef2d-8e70-431e-b20d-36db9ca0dbb2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:34.444260 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4466ef2d-8e70-431e-b20d-36db9ca0dbb2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:34.445053 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4466ef2d-8e70-431e-b20d-36db9ca0dbb2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:34.445491 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4466ef2d-8e70-431e-b20d-36db9ca0dbb2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:34.583463 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-bb7e74db-744d-4d8f-8fb0-31e1bc271d56 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:34.584063 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-bb7e74db-744d-4d8f-8fb0-31e1bc271d56 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:34.590618 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bb7e74db-744d-4d8f-8fb0-31e1bc271d56 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:34.591070 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bb7e74db-744d-4d8f-8fb0-31e1bc271d56 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:34.591949 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bb7e74db-744d-4d8f-8fb0-31e1bc271d56 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:34.592532 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bb7e74db-744d-4d8f-8fb0-31e1bc271d56 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:34.602600 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4466ef2d-8e70-431e-b20d-36db9ca0dbb2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:34.621087 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4466ef2d-8e70-431e-b20d-36db9ca0dbb2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.188178 Jan 28 00:55:34.622174 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 302/582] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:34 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:34.757202 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-bb7e74db-744d-4d8f-8fb0-31e1bc271d56 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:34.766907 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-bb7e74db-744d-4d8f-8fb0-31e1bc271d56 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.188062 Jan 28 00:55:34.767547 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 281/583] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:34 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:35.042768 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3e45885f-de49-461b-99e0-946f1d0ea5f8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:35.043760 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3e45885f-de49-461b-99e0-946f1d0ea5f8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:35.052416 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3e45885f-de49-461b-99e0-946f1d0ea5f8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:35.052868 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3e45885f-de49-461b-99e0-946f1d0ea5f8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:35.053666 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3e45885f-de49-461b-99e0-946f1d0ea5f8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:35.054105 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3e45885f-de49-461b-99e0-946f1d0ea5f8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:35.213001 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3e45885f-de49-461b-99e0-946f1d0ea5f8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:35.223379 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3e45885f-de49-461b-99e0-946f1d0ea5f8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:35.225028 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3e45885f-de49-461b-99e0-946f1d0ea5f8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:35.226268 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3e45885f-de49-461b-99e0-946f1d0ea5f8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.189633 Jan 28 00:55:35.226856 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 303/584] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:35 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:35.384458 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4deaca52-2458-4af8-a910-b8184c19b9bb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:35.385277 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4deaca52-2458-4af8-a910-b8184c19b9bb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:35.393269 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4deaca52-2458-4af8-a910-b8184c19b9bb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:35.393740 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4deaca52-2458-4af8-a910-b8184c19b9bb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:35.394551 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4deaca52-2458-4af8-a910-b8184c19b9bb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:35.395000 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4deaca52-2458-4af8-a910-b8184c19b9bb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:35.554118 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4deaca52-2458-4af8-a910-b8184c19b9bb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:35.564284 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4deaca52-2458-4af8-a910-b8184c19b9bb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.184087 Jan 28 00:55:35.564926 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 282/585] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:35 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:35.644629 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f70a057a-fed6-4730-8cd4-dd6ea7191260 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:35.645379 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f70a057a-fed6-4730-8cd4-dd6ea7191260 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:35.654284 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f70a057a-fed6-4730-8cd4-dd6ea7191260 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:35.655652 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f70a057a-fed6-4730-8cd4-dd6ea7191260 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:35.657125 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f70a057a-fed6-4730-8cd4-dd6ea7191260 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:35.657871 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f70a057a-fed6-4730-8cd4-dd6ea7191260 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:35.793551 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e4a118dd-5129-4f9b-80bf-c94879642fa6 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:35.793551 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e4a118dd-5129-4f9b-80bf-c94879642fa6 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:35.804562 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e4a118dd-5129-4f9b-80bf-c94879642fa6 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:35.805197 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e4a118dd-5129-4f9b-80bf-c94879642fa6 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:35.806666 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e4a118dd-5129-4f9b-80bf-c94879642fa6 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:35.807446 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e4a118dd-5129-4f9b-80bf-c94879642fa6 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:35.905848 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f70a057a-fed6-4730-8cd4-dd6ea7191260 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:35.919103 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f70a057a-fed6-4730-8cd4-dd6ea7191260 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.277690 Jan 28 00:55:35.919870 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 304/586] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:35 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:36.043083 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e4a118dd-5129-4f9b-80bf-c94879642fa6 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:36.055327 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e4a118dd-5129-4f9b-80bf-c94879642fa6 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.274676 Jan 28 00:55:36.069199 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 283/587] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:35 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:36.248183 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1770537a-2c8d-4677-a88c-308c6d7dfa33 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:36.249380 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1770537a-2c8d-4677-a88c-308c6d7dfa33 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:36.256763 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1770537a-2c8d-4677-a88c-308c6d7dfa33 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:36.257497 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1770537a-2c8d-4677-a88c-308c6d7dfa33 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:36.258343 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1770537a-2c8d-4677-a88c-308c6d7dfa33 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:36.259025 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1770537a-2c8d-4677-a88c-308c6d7dfa33 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:36.481123 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-1770537a-2c8d-4677-a88c-308c6d7dfa33 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:36.499824 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-1770537a-2c8d-4677-a88c-308c6d7dfa33 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:36.502734 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-1770537a-2c8d-4677-a88c-308c6d7dfa33 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:36.504854 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1770537a-2c8d-4677-a88c-308c6d7dfa33 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.260500 Jan 28 00:55:36.516728 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 305/588] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:36 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:55:36.585288 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d48ab615-ae2d-4373-8c8f-8ce6e0c6b143 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:36.585906 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d48ab615-ae2d-4373-8c8f-8ce6e0c6b143 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:36.593450 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d48ab615-ae2d-4373-8c8f-8ce6e0c6b143 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:36.593906 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d48ab615-ae2d-4373-8c8f-8ce6e0c6b143 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:36.594715 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d48ab615-ae2d-4373-8c8f-8ce6e0c6b143 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:36.595329 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d48ab615-ae2d-4373-8c8f-8ce6e0c6b143 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:36.746473 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d48ab615-ae2d-4373-8c8f-8ce6e0c6b143 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:36.755870 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d48ab615-ae2d-4373-8c8f-8ce6e0c6b143 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.174142 Jan 28 00:55:36.756385 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 284/589] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:36 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:36.939071 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-a9a8d13b-32d8-40a5-91c4-0e02b4709a12 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:36.940072 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-a9a8d13b-32d8-40a5-91c4-0e02b4709a12 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:36.964984 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a9a8d13b-32d8-40a5-91c4-0e02b4709a12 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:36.966037 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a9a8d13b-32d8-40a5-91c4-0e02b4709a12 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:36.969781 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a9a8d13b-32d8-40a5-91c4-0e02b4709a12 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:36.970788 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a9a8d13b-32d8-40a5-91c4-0e02b4709a12 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:37.078038 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1e60728d-11e9-49f0-acce-5673325eb3f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:37.079746 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-1e60728d-11e9-49f0-acce-5673325eb3f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:37.088070 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1e60728d-11e9-49f0-acce-5673325eb3f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:37.088539 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1e60728d-11e9-49f0-acce-5673325eb3f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:37.089362 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1e60728d-11e9-49f0-acce-5673325eb3f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:37.089803 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1e60728d-11e9-49f0-acce-5673325eb3f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:37.218248 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-a9a8d13b-32d8-40a5-91c4-0e02b4709a12 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:37.229569 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-a9a8d13b-32d8-40a5-91c4-0e02b4709a12 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.294895 Jan 28 00:55:37.230220 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 306/590] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:36 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:37.333213 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-1e60728d-11e9-49f0-acce-5673325eb3f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:37.345529 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1e60728d-11e9-49f0-acce-5673325eb3f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.272450 Jan 28 00:55:37.346837 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 285/591] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:37 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:37.525818 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4eda7e11-66b1-445a-978b-0b0e5b524e05 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:37.526427 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4eda7e11-66b1-445a-978b-0b0e5b524e05 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:37.533802 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4eda7e11-66b1-445a-978b-0b0e5b524e05 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:37.535595 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4eda7e11-66b1-445a-978b-0b0e5b524e05 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:37.536645 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4eda7e11-66b1-445a-978b-0b0e5b524e05 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:37.537183 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4eda7e11-66b1-445a-978b-0b0e5b524e05 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:37.699434 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4eda7e11-66b1-445a-978b-0b0e5b524e05 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:37.708794 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4eda7e11-66b1-445a-978b-0b0e5b524e05 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:37.710319 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4eda7e11-66b1-445a-978b-0b0e5b524e05 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:37.711608 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4eda7e11-66b1-445a-978b-0b0e5b524e05 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.189443 Jan 28 00:55:37.712176 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 307/592] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:37 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:37.774226 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-56b26ea0-7df4-42d9-a652-020a2ba448e3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:37.775046 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-56b26ea0-7df4-42d9-a652-020a2ba448e3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:37.783033 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-56b26ea0-7df4-42d9-a652-020a2ba448e3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:37.783860 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-56b26ea0-7df4-42d9-a652-020a2ba448e3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:37.784703 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-56b26ea0-7df4-42d9-a652-020a2ba448e3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:37.785279 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-56b26ea0-7df4-42d9-a652-020a2ba448e3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:37.932031 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-56b26ea0-7df4-42d9-a652-020a2ba448e3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:37.941828 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-56b26ea0-7df4-42d9-a652-020a2ba448e3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.170965 Jan 28 00:55:37.942414 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 286/593] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:37 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:38.250449 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f629d338-37bf-44ac-beef-522c8ddcde8a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:38.252395 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f629d338-37bf-44ac-beef-522c8ddcde8a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:38.258032 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f629d338-37bf-44ac-beef-522c8ddcde8a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:38.258581 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f629d338-37bf-44ac-beef-522c8ddcde8a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:38.259519 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f629d338-37bf-44ac-beef-522c8ddcde8a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:38.260399 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f629d338-37bf-44ac-beef-522c8ddcde8a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:38.367659 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-166b514d-2ca7-4610-8031-0dfdc79e7641 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:38.368649 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-166b514d-2ca7-4610-8031-0dfdc79e7641 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:38.403185 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-166b514d-2ca7-4610-8031-0dfdc79e7641 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:38.403800 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-166b514d-2ca7-4610-8031-0dfdc79e7641 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:38.404732 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-166b514d-2ca7-4610-8031-0dfdc79e7641 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:38.405275 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-166b514d-2ca7-4610-8031-0dfdc79e7641 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:38.480833 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f629d338-37bf-44ac-beef-522c8ddcde8a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:38.494316 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f629d338-37bf-44ac-beef-522c8ddcde8a tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.250920 Jan 28 00:55:38.505584 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 308/594] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:38 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:38.642359 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-166b514d-2ca7-4610-8031-0dfdc79e7641 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:38.658668 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-166b514d-2ca7-4610-8031-0dfdc79e7641 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.296986 Jan 28 00:55:38.670765 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 287/595] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:38 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:38.729534 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-bffda8a8-b5bb-4b05-85cb-30ec67e6809d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:38.730104 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-bffda8a8-b5bb-4b05-85cb-30ec67e6809d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:38.737446 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bffda8a8-b5bb-4b05-85cb-30ec67e6809d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:38.737973 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bffda8a8-b5bb-4b05-85cb-30ec67e6809d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:38.738725 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bffda8a8-b5bb-4b05-85cb-30ec67e6809d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:38.739174 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bffda8a8-b5bb-4b05-85cb-30ec67e6809d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:38.893405 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-bffda8a8-b5bb-4b05-85cb-30ec67e6809d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:38.903892 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-bffda8a8-b5bb-4b05-85cb-30ec67e6809d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:38.906600 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-bffda8a8-b5bb-4b05-85cb-30ec67e6809d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:38.908780 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-bffda8a8-b5bb-4b05-85cb-30ec67e6809d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.182989 Jan 28 00:55:38.909722 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 309/596] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:38 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:38.960950 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c7b3d102-83a7-4cbc-94c4-ddc825397679 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:38.961558 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c7b3d102-83a7-4cbc-94c4-ddc825397679 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:38.971029 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c7b3d102-83a7-4cbc-94c4-ddc825397679 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:38.971655 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c7b3d102-83a7-4cbc-94c4-ddc825397679 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:38.972667 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c7b3d102-83a7-4cbc-94c4-ddc825397679 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:38.973108 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c7b3d102-83a7-4cbc-94c4-ddc825397679 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:39.175651 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-c7b3d102-83a7-4cbc-94c4-ddc825397679 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:39.184723 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c7b3d102-83a7-4cbc-94c4-ddc825397679 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.227811 Jan 28 00:55:39.184723 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 288/597] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:38 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:39.526264 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1bb67d91-217e-4bba-9327-3fe113c737ac tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:39.527419 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1bb67d91-217e-4bba-9327-3fe113c737ac tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:39.538713 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1bb67d91-217e-4bba-9327-3fe113c737ac tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:39.539532 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1bb67d91-217e-4bba-9327-3fe113c737ac tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:39.540957 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1bb67d91-217e-4bba-9327-3fe113c737ac tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:39.541821 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1bb67d91-217e-4bba-9327-3fe113c737ac tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:39.677961 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-70227f60-f219-49b6-9c35-392f44a57a5f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:39.678748 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-70227f60-f219-49b6-9c35-392f44a57a5f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:39.686499 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-70227f60-f219-49b6-9c35-392f44a57a5f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:39.686956 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-70227f60-f219-49b6-9c35-392f44a57a5f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:39.687833 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-70227f60-f219-49b6-9c35-392f44a57a5f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:39.688430 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-70227f60-f219-49b6-9c35-392f44a57a5f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:39.754503 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-1bb67d91-217e-4bba-9327-3fe113c737ac tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:39.764819 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1bb67d91-217e-4bba-9327-3fe113c737ac tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.253609 Jan 28 00:55:39.787038 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 310/598] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:39 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:39.895175 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-70227f60-f219-49b6-9c35-392f44a57a5f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:39.905820 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-70227f60-f219-49b6-9c35-392f44a57a5f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.231505 Jan 28 00:55:39.907435 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 289/599] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:39 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:39.930707 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-cf4d8dbe-3812-450f-bdd7-100953e816e8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:39.931614 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-cf4d8dbe-3812-450f-bdd7-100953e816e8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:39.942882 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf4d8dbe-3812-450f-bdd7-100953e816e8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:39.943882 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf4d8dbe-3812-450f-bdd7-100953e816e8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:39.944975 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf4d8dbe-3812-450f-bdd7-100953e816e8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:39.945626 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf4d8dbe-3812-450f-bdd7-100953e816e8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:40.152775 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cf4d8dbe-3812-450f-bdd7-100953e816e8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:40.166666 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cf4d8dbe-3812-450f-bdd7-100953e816e8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:40.168251 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cf4d8dbe-3812-450f-bdd7-100953e816e8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:40.169455 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-cf4d8dbe-3812-450f-bdd7-100953e816e8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.244061 Jan 28 00:55:40.170034 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 311/600] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:39 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:40.209719 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-56f965a6-a027-4711-8ef9-c012d7bd973e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:40.212199 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-56f965a6-a027-4711-8ef9-c012d7bd973e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:40.222168 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-56f965a6-a027-4711-8ef9-c012d7bd973e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:40.222899 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-56f965a6-a027-4711-8ef9-c012d7bd973e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:40.224089 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-56f965a6-a027-4711-8ef9-c012d7bd973e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:40.224656 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-56f965a6-a027-4711-8ef9-c012d7bd973e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:40.369077 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-56f965a6-a027-4711-8ef9-c012d7bd973e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:40.378253 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-56f965a6-a027-4711-8ef9-c012d7bd973e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.175405 Jan 28 00:55:40.378978 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 290/601] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:40 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:40.785514 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-03c38f16-9adb-411c-a47c-e78e7add2f32 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:40.786232 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-03c38f16-9adb-411c-a47c-e78e7add2f32 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:40.796381 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-03c38f16-9adb-411c-a47c-e78e7add2f32 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:40.796949 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-03c38f16-9adb-411c-a47c-e78e7add2f32 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:40.797819 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-03c38f16-9adb-411c-a47c-e78e7add2f32 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:40.798377 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-03c38f16-9adb-411c-a47c-e78e7add2f32 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:40.923794 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d2cb1749-9e80-4ce7-82db-c3a54705a7e4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:40.924995 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d2cb1749-9e80-4ce7-82db-c3a54705a7e4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:40.938987 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d2cb1749-9e80-4ce7-82db-c3a54705a7e4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:40.939683 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d2cb1749-9e80-4ce7-82db-c3a54705a7e4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:40.940740 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d2cb1749-9e80-4ce7-82db-c3a54705a7e4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:40.941597 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d2cb1749-9e80-4ce7-82db-c3a54705a7e4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:40.965541 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-03c38f16-9adb-411c-a47c-e78e7add2f32 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:40.974643 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-03c38f16-9adb-411c-a47c-e78e7add2f32 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.192555 Jan 28 00:55:40.975430 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 312/602] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:40 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:41.095782 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d2cb1749-9e80-4ce7-82db-c3a54705a7e4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:41.103637 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d2cb1749-9e80-4ce7-82db-c3a54705a7e4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.184252 Jan 28 00:55:41.104452 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 291/603] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:40 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:41.193402 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-8ede27e3-734f-40e5-aec9-27d245cced1a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:41.194153 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-8ede27e3-734f-40e5-aec9-27d245cced1a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:41.200975 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8ede27e3-734f-40e5-aec9-27d245cced1a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:41.201439 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8ede27e3-734f-40e5-aec9-27d245cced1a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:41.202375 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8ede27e3-734f-40e5-aec9-27d245cced1a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:41.202907 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8ede27e3-734f-40e5-aec9-27d245cced1a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:41.398816 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b81a6710-acfb-41ce-84e2-4a7b85573e15 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:41.399693 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b81a6710-acfb-41ce-84e2-4a7b85573e15 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:41.419624 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b81a6710-acfb-41ce-84e2-4a7b85573e15 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:41.420188 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b81a6710-acfb-41ce-84e2-4a7b85573e15 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:41.421647 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b81a6710-acfb-41ce-84e2-4a7b85573e15 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:41.422094 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b81a6710-acfb-41ce-84e2-4a7b85573e15 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:41.655196 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-8ede27e3-734f-40e5-aec9-27d245cced1a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:41.664430 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-8ede27e3-734f-40e5-aec9-27d245cced1a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:41.665973 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-8ede27e3-734f-40e5-aec9-27d245cced1a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:41.667150 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-8ede27e3-734f-40e5-aec9-27d245cced1a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.480018 Jan 28 00:55:41.667750 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 313/604] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:41 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:41.766575 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b81a6710-acfb-41ce-84e2-4a7b85573e15 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:41.775137 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b81a6710-acfb-41ce-84e2-4a7b85573e15 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.380850 Jan 28 00:55:41.775983 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 292/605] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:41 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:42.003884 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-84f096f6-8233-4dae-b4d7-855e7ea4c9fa tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:42.004511 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-84f096f6-8233-4dae-b4d7-855e7ea4c9fa tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:42.013402 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-84f096f6-8233-4dae-b4d7-855e7ea4c9fa tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:42.013897 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-84f096f6-8233-4dae-b4d7-855e7ea4c9fa tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:42.015195 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-84f096f6-8233-4dae-b4d7-855e7ea4c9fa tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:42.015618 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-84f096f6-8233-4dae-b4d7-855e7ea4c9fa tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:42.121856 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-27d3d8f0-e011-45df-99f5-1724cc3e55c8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:42.122514 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-27d3d8f0-e011-45df-99f5-1724cc3e55c8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:42.130954 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-27d3d8f0-e011-45df-99f5-1724cc3e55c8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:42.131552 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-27d3d8f0-e011-45df-99f5-1724cc3e55c8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:42.132351 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-27d3d8f0-e011-45df-99f5-1724cc3e55c8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:42.132792 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-27d3d8f0-e011-45df-99f5-1724cc3e55c8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:42.233402 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-84f096f6-8233-4dae-b4d7-855e7ea4c9fa tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:42.254393 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-84f096f6-8233-4dae-b4d7-855e7ea4c9fa tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.254308 Jan 28 00:55:42.265243 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 314/606] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:41 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:42.345145 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-27d3d8f0-e011-45df-99f5-1724cc3e55c8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:42.355441 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-27d3d8f0-e011-45df-99f5-1724cc3e55c8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.237156 Jan 28 00:55:42.356583 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 293/607] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:42 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:42.686094 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-5f7e0833-396a-4a1c-ab8b-fffb0f91fbf5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:42.686882 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-5f7e0833-396a-4a1c-ab8b-fffb0f91fbf5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:42.693317 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5f7e0833-396a-4a1c-ab8b-fffb0f91fbf5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:42.693768 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5f7e0833-396a-4a1c-ab8b-fffb0f91fbf5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:42.694569 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5f7e0833-396a-4a1c-ab8b-fffb0f91fbf5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:42.695013 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5f7e0833-396a-4a1c-ab8b-fffb0f91fbf5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:42.796712 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b4caaa0d-67ff-40d1-9924-614e376b9187 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:42.797665 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b4caaa0d-67ff-40d1-9924-614e376b9187 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:42.808024 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b4caaa0d-67ff-40d1-9924-614e376b9187 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:42.808478 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b4caaa0d-67ff-40d1-9924-614e376b9187 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:42.809355 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b4caaa0d-67ff-40d1-9924-614e376b9187 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:42.809707 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b4caaa0d-67ff-40d1-9924-614e376b9187 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:42.867255 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-5f7e0833-396a-4a1c-ab8b-fffb0f91fbf5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:42.879529 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-5f7e0833-396a-4a1c-ab8b-fffb0f91fbf5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:42.882123 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-5f7e0833-396a-4a1c-ab8b-fffb0f91fbf5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:42.884000 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-5f7e0833-396a-4a1c-ab8b-fffb0f91fbf5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.202278 Jan 28 00:55:42.891628 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 315/608] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:42 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:42.970760 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b4caaa0d-67ff-40d1-9924-614e376b9187 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:42.980464 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b4caaa0d-67ff-40d1-9924-614e376b9187 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.187894 Jan 28 00:55:42.981052 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 294/609] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:42 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:43.276130 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d0df464f-af9b-455d-a0f9-1c6c384b147e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:43.276896 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d0df464f-af9b-455d-a0f9-1c6c384b147e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:43.284094 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d0df464f-af9b-455d-a0f9-1c6c384b147e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:43.284548 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d0df464f-af9b-455d-a0f9-1c6c384b147e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:43.285377 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d0df464f-af9b-455d-a0f9-1c6c384b147e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:43.285816 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d0df464f-af9b-455d-a0f9-1c6c384b147e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:43.373032 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-cc113ef8-264c-4e73-bc13-57c2023fca2c tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:43.374254 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-cc113ef8-264c-4e73-bc13-57c2023fca2c tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:43.381837 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cc113ef8-264c-4e73-bc13-57c2023fca2c tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:43.382348 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cc113ef8-264c-4e73-bc13-57c2023fca2c tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:43.383290 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cc113ef8-264c-4e73-bc13-57c2023fca2c tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:43.383791 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cc113ef8-264c-4e73-bc13-57c2023fca2c tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:43.430136 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d0df464f-af9b-455d-a0f9-1c6c384b147e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:43.438788 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d0df464f-af9b-455d-a0f9-1c6c384b147e tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.166385 Jan 28 00:55:43.439441 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 316/610] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:43 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:43.552295 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-cc113ef8-264c-4e73-bc13-57c2023fca2c tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:43.565040 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-cc113ef8-264c-4e73-bc13-57c2023fca2c tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.195350 Jan 28 00:55:43.565783 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 295/611] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:43 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:43.904179 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-aa7c39d9-e09a-422e-ac6e-f2e068c989af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:43.905322 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-aa7c39d9-e09a-422e-ac6e-f2e068c989af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:43.913051 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-aa7c39d9-e09a-422e-ac6e-f2e068c989af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:43.913051 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-aa7c39d9-e09a-422e-ac6e-f2e068c989af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:43.913542 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-aa7c39d9-e09a-422e-ac6e-f2e068c989af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:43.914397 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-aa7c39d9-e09a-422e-ac6e-f2e068c989af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:44.001572 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c61dc006-b4bc-4212-a72d-623cc86a6a12 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:44.003868 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c61dc006-b4bc-4212-a72d-623cc86a6a12 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:44.008534 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c61dc006-b4bc-4212-a72d-623cc86a6a12 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:44.009003 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c61dc006-b4bc-4212-a72d-623cc86a6a12 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:44.009808 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c61dc006-b4bc-4212-a72d-623cc86a6a12 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:44.010259 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c61dc006-b4bc-4212-a72d-623cc86a6a12 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:44.069166 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-aa7c39d9-e09a-422e-ac6e-f2e068c989af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:44.078715 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-aa7c39d9-e09a-422e-ac6e-f2e068c989af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:44.092883 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-aa7c39d9-e09a-422e-ac6e-f2e068c989af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:44.092883 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-aa7c39d9-e09a-422e-ac6e-f2e068c989af tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.181396 Jan 28 00:55:44.092883 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 317/612] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:43 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:44.169132 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-c61dc006-b4bc-4212-a72d-623cc86a6a12 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:44.177717 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c61dc006-b4bc-4212-a72d-623cc86a6a12 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1724 microversion: 2.1 time: 0.180515 Jan 28 00:55:44.178308 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 296/613] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:43 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:44.455702 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-fc98a73b-7588-4bc6-9429-c0166f2d83ca tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:44.456256 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-fc98a73b-7588-4bc6-9429-c0166f2d83ca tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:44.463466 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fc98a73b-7588-4bc6-9429-c0166f2d83ca tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:44.463923 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fc98a73b-7588-4bc6-9429-c0166f2d83ca tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:44.464718 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fc98a73b-7588-4bc6-9429-c0166f2d83ca tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:44.465156 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fc98a73b-7588-4bc6-9429-c0166f2d83ca tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:44.589263 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-cde5ab2d-be77-4737-b749-11f403ef302b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:44.589996 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-cde5ab2d-be77-4737-b749-11f403ef302b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:44.598959 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cde5ab2d-be77-4737-b749-11f403ef302b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:44.599956 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cde5ab2d-be77-4737-b749-11f403ef302b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:44.600968 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cde5ab2d-be77-4737-b749-11f403ef302b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:44.601390 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cde5ab2d-be77-4737-b749-11f403ef302b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:44.620769 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-fc98a73b-7588-4bc6-9429-c0166f2d83ca tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:44.628345 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-fc98a73b-7588-4bc6-9429-c0166f2d83ca tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.176782 Jan 28 00:55:44.628956 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 318/614] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:44 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:44.743197 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-cde5ab2d-be77-4737-b749-11f403ef302b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:44.752253 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-cde5ab2d-be77-4737-b749-11f403ef302b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.166681 Jan 28 00:55:44.752842 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 297/615] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:44 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:45.105576 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-33f97413-5eaa-4dcd-864d-f6a31e4db24f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:45.106457 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-33f97413-5eaa-4dcd-864d-f6a31e4db24f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:45.115726 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-33f97413-5eaa-4dcd-864d-f6a31e4db24f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:45.116536 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-33f97413-5eaa-4dcd-864d-f6a31e4db24f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:45.117837 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-33f97413-5eaa-4dcd-864d-f6a31e4db24f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:45.118581 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-33f97413-5eaa-4dcd-864d-f6a31e4db24f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:45.194187 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e46b2dd8-a14c-4ade-babf-4a51373708ed tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:45.194995 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e46b2dd8-a14c-4ade-babf-4a51373708ed tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:45.202070 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e46b2dd8-a14c-4ade-babf-4a51373708ed tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:45.202876 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e46b2dd8-a14c-4ade-babf-4a51373708ed tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:45.204386 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e46b2dd8-a14c-4ade-babf-4a51373708ed tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:45.205121 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e46b2dd8-a14c-4ade-babf-4a51373708ed tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:45.318662 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-33f97413-5eaa-4dcd-864d-f6a31e4db24f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:45.332725 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-33f97413-5eaa-4dcd-864d-f6a31e4db24f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:45.336884 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-33f97413-5eaa-4dcd-864d-f6a31e4db24f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:45.338193 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-33f97413-5eaa-4dcd-864d-f6a31e4db24f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.239991 Jan 28 00:55:45.338778 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 319/616] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:45 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:45.399241 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e46b2dd8-a14c-4ade-babf-4a51373708ed tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:45.410978 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e46b2dd8-a14c-4ade-babf-4a51373708ed tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1701 microversion: 2.1 time: 0.220617 Jan 28 00:55:45.411895 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 298/617] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:45 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1701 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:45.431954 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-23b71ece-77cb-453c-bb5d-0e87c25d5c5a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:55:45.438533 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-23b71ece-77cb-453c-bb5d-0e87c25d5c5a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:45.439016 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-23b71ece-77cb-453c-bb5d-0e87c25d5c5a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:45.508054 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-23b71ece-77cb-453c-bb5d-0e87c25d5c5a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Going to try to start instance {{(pid=127862) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 28 00:55:45.573880 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-23b71ece-77cb-453c-bb5d-0e87c25d5c5a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 202 len: 0 microversion: 2.1 time: 0.147053 Jan 28 00:55:45.574538 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 320/618] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:55:45 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:55:45.585429 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4c60b50e-6694-48a1-9b00-e07eda456d56 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:45.586279 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4c60b50e-6694-48a1-9b00-e07eda456d56 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:45.596686 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4c60b50e-6694-48a1-9b00-e07eda456d56 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:45.597500 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4c60b50e-6694-48a1-9b00-e07eda456d56 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:45.599471 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4c60b50e-6694-48a1-9b00-e07eda456d56 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:45.600249 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4c60b50e-6694-48a1-9b00-e07eda456d56 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:45.646221 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1794bbba-754d-4b28-a380-02bfdd8e57d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:45.647004 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1794bbba-754d-4b28-a380-02bfdd8e57d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:45.659157 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1794bbba-754d-4b28-a380-02bfdd8e57d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:45.659631 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1794bbba-754d-4b28-a380-02bfdd8e57d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:45.665716 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1794bbba-754d-4b28-a380-02bfdd8e57d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:45.666358 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1794bbba-754d-4b28-a380-02bfdd8e57d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:45.979575 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4c60b50e-6694-48a1-9b00-e07eda456d56 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:46.004770 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4c60b50e-6694-48a1-9b00-e07eda456d56 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1710 microversion: 2.1 time: 0.424931 Jan 28 00:55:46.017695 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 299/619] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:45 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1710 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:46.026735 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-1794bbba-754d-4b28-a380-02bfdd8e57d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:46.055169 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1794bbba-754d-4b28-a380-02bfdd8e57d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.413380 Jan 28 00:55:46.057205 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 321/620] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:45 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:46.108731 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2e8dbc0b-bdb8-4a9e-9668-29a1cdac7b70 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:46.109415 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2e8dbc0b-bdb8-4a9e-9668-29a1cdac7b70 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:46.128834 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2e8dbc0b-bdb8-4a9e-9668-29a1cdac7b70 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:46.129248 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2e8dbc0b-bdb8-4a9e-9668-29a1cdac7b70 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:46.130089 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2e8dbc0b-bdb8-4a9e-9668-29a1cdac7b70 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:46.130569 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2e8dbc0b-bdb8-4a9e-9668-29a1cdac7b70 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:46.332880 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-c851e0b6-42c5-4d94-967c-94211c83eb2c req-c68f9fab-b23e-4401-94cb-211249e3afee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "060e1452-5aba-4323-894d-a04d6aed8785", "tag": "1f359392-df9f-424a-b687-8308d8dcbece"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:55:46.336638 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:55:46.336638 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:55:46.376260 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-c851e0b6-42c5-4d94-967c-94211c83eb2c req-c68f9fab-b23e-4401-94cb-211249e3afee service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:46.386225 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-c851e0b6-42c5-4d94-967c-94211c83eb2c req-c68f9fab-b23e-4401-94cb-211249e3afee service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:46.445667 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-c851e0b6-42c5-4d94-967c-94211c83eb2c req-c68f9fab-b23e-4401-94cb-211249e3afee service nova] Creating event network-changed:1f359392-df9f-424a-b687-8308d8dcbece for instance 060e1452-5aba-4323-894d-a04d6aed8785 on hv-cinder-80952 Jan 28 00:55:46.461188 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-c851e0b6-42c5-4d94-967c-94211c83eb2c req-c68f9fab-b23e-4401-94cb-211249e3afee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132690 Jan 28 00:55:46.464927 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 322/621] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:55:46.485546 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-99b88c95-5773-4b63-823e-7df383007b8f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:46.487706 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-99b88c95-5773-4b63-823e-7df383007b8f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:46.523232 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-99b88c95-5773-4b63-823e-7df383007b8f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:46.523963 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-99b88c95-5773-4b63-823e-7df383007b8f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:46.530090 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-99b88c95-5773-4b63-823e-7df383007b8f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:46.536104 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-99b88c95-5773-4b63-823e-7df383007b8f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:46.830478 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-2e8dbc0b-bdb8-4a9e-9668-29a1cdac7b70 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:46.849887 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2e8dbc0b-bdb8-4a9e-9668-29a1cdac7b70 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.819889 Jan 28 00:55:46.860977 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 300/622] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:46 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:47.031527 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-99b88c95-5773-4b63-823e-7df383007b8f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:47.040935 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-99b88c95-5773-4b63-823e-7df383007b8f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:47.044229 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-99b88c95-5773-4b63-823e-7df383007b8f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:47.046334 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-99b88c95-5773-4b63-823e-7df383007b8f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.576896 Jan 28 00:55:47.047544 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 323/623] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:46 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:47.052061 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-6eb04e2e-47fb-4780-b970-bdebe792cd32 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:47.052687 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-6eb04e2e-47fb-4780-b970-bdebe792cd32 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:47.059454 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6eb04e2e-47fb-4780-b970-bdebe792cd32 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:47.059931 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6eb04e2e-47fb-4780-b970-bdebe792cd32 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:47.061493 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6eb04e2e-47fb-4780-b970-bdebe792cd32 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:47.062405 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6eb04e2e-47fb-4780-b970-bdebe792cd32 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:47.131444 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-e2f45960-c174-4baf-bb45-2b8d5d328240 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:47.132363 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-e2f45960-c174-4baf-bb45-2b8d5d328240 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:47.145873 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e2f45960-c174-4baf-bb45-2b8d5d328240 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:47.146607 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e2f45960-c174-4baf-bb45-2b8d5d328240 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:47.147620 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e2f45960-c174-4baf-bb45-2b8d5d328240 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:47.148225 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e2f45960-c174-4baf-bb45-2b8d5d328240 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:47.399660 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-6eb04e2e-47fb-4780-b970-bdebe792cd32 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:47.410685 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-6eb04e2e-47fb-4780-b970-bdebe792cd32 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1710 microversion: 2.1 time: 0.361680 Jan 28 00:55:47.421052 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 301/624] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:47 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1710 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:47.494428 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-e2f45960-c174-4baf-bb45-2b8d5d328240 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:47.504171 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-e2f45960-c174-4baf-bb45-2b8d5d328240 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.376290 Jan 28 00:55:47.505349 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 324/625] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:47 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:47.868551 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2953c48f-ecd2-4432-8dfa-978890cf8f0a tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:47.869401 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2953c48f-ecd2-4432-8dfa-978890cf8f0a tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:47.881794 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2953c48f-ecd2-4432-8dfa-978890cf8f0a tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:47.882254 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2953c48f-ecd2-4432-8dfa-978890cf8f0a tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:47.883228 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2953c48f-ecd2-4432-8dfa-978890cf8f0a tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:47.891611 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2953c48f-ecd2-4432-8dfa-978890cf8f0a tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:48.067671 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-74041298-fabc-455b-a338-abd9182bdca1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:48.069148 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-74041298-fabc-455b-a338-abd9182bdca1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:48.078564 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-74041298-fabc-455b-a338-abd9182bdca1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:48.079543 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-74041298-fabc-455b-a338-abd9182bdca1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:48.080469 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-74041298-fabc-455b-a338-abd9182bdca1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:48.080937 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-74041298-fabc-455b-a338-abd9182bdca1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:48.081728 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-2953c48f-ecd2-4432-8dfa-978890cf8f0a tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:48.093593 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2953c48f-ecd2-4432-8dfa-978890cf8f0a tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.228851 Jan 28 00:55:48.094479 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 302/626] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:47 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:48.247871 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-74041298-fabc-455b-a338-abd9182bdca1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:48.258527 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-74041298-fabc-455b-a338-abd9182bdca1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:48.259956 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-74041298-fabc-455b-a338-abd9182bdca1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:48.261446 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-74041298-fabc-455b-a338-abd9182bdca1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.197834 Jan 28 00:55:48.262291 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 325/627] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:48 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:48.428644 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-05700b99-52ea-435d-a7b1-e6a4f2971127 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:48.429389 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-05700b99-52ea-435d-a7b1-e6a4f2971127 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:48.436641 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-05700b99-52ea-435d-a7b1-e6a4f2971127 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:48.437093 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-05700b99-52ea-435d-a7b1-e6a4f2971127 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:48.437899 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-05700b99-52ea-435d-a7b1-e6a4f2971127 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:48.438342 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-05700b99-52ea-435d-a7b1-e6a4f2971127 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:48.524977 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-c1ea5833-fb7e-45ca-9e2d-5adcfe337930 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:48.526162 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-c1ea5833-fb7e-45ca-9e2d-5adcfe337930 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:48.534282 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c1ea5833-fb7e-45ca-9e2d-5adcfe337930 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:48.535046 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c1ea5833-fb7e-45ca-9e2d-5adcfe337930 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:48.536219 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c1ea5833-fb7e-45ca-9e2d-5adcfe337930 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:48.536850 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c1ea5833-fb7e-45ca-9e2d-5adcfe337930 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:48.663396 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-05700b99-52ea-435d-a7b1-e6a4f2971127 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:48.674002 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-05700b99-52ea-435d-a7b1-e6a4f2971127 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1710 microversion: 2.1 time: 0.249087 Jan 28 00:55:48.689041 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 303/628] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:48 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1710 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:48.785808 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c1ea5833-fb7e-45ca-9e2d-5adcfe337930 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:48.799875 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-c1ea5833-fb7e-45ca-9e2d-5adcfe337930 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.281890 Jan 28 00:55:48.802646 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 326/629] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:48 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:49.115135 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-04b37971-fa28-4254-8d60-62dacd994bc8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:49.116378 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-04b37971-fa28-4254-8d60-62dacd994bc8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:49.132688 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-04b37971-fa28-4254-8d60-62dacd994bc8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:49.133145 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-04b37971-fa28-4254-8d60-62dacd994bc8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:49.133952 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-04b37971-fa28-4254-8d60-62dacd994bc8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:49.134401 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-04b37971-fa28-4254-8d60-62dacd994bc8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:49.281732 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3401fe48-4827-42e0-94cc-18145ca03e93 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:49.282379 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3401fe48-4827-42e0-94cc-18145ca03e93 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:49.288577 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3401fe48-4827-42e0-94cc-18145ca03e93 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:49.289407 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3401fe48-4827-42e0-94cc-18145ca03e93 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:49.290453 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3401fe48-4827-42e0-94cc-18145ca03e93 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:49.291139 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3401fe48-4827-42e0-94cc-18145ca03e93 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:49.329919 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-04b37971-fa28-4254-8d60-62dacd994bc8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:49.338304 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-04b37971-fa28-4254-8d60-62dacd994bc8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.227509 Jan 28 00:55:49.339082 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 304/630] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:49 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:49.466551 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3401fe48-4827-42e0-94cc-18145ca03e93 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:49.476785 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3401fe48-4827-42e0-94cc-18145ca03e93 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:49.478537 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3401fe48-4827-42e0-94cc-18145ca03e93 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:49.480019 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3401fe48-4827-42e0-94cc-18145ca03e93 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.203188 Jan 28 00:55:49.480881 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 327/631] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:49 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:49.702950 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-edb0c253-23cc-4698-8e61-af74bab90593 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:49.703458 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-edb0c253-23cc-4698-8e61-af74bab90593 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:49.709925 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-edb0c253-23cc-4698-8e61-af74bab90593 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:49.710376 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-edb0c253-23cc-4698-8e61-af74bab90593 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:49.711162 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-edb0c253-23cc-4698-8e61-af74bab90593 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:49.711626 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-edb0c253-23cc-4698-8e61-af74bab90593 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:49.817851 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7bd6d947-dff3-4d6f-ae6c-bd0d664bc345 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:49.818465 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7bd6d947-dff3-4d6f-ae6c-bd0d664bc345 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:49.825585 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7bd6d947-dff3-4d6f-ae6c-bd0d664bc345 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:49.826975 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7bd6d947-dff3-4d6f-ae6c-bd0d664bc345 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:49.828164 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7bd6d947-dff3-4d6f-ae6c-bd0d664bc345 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:49.829193 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7bd6d947-dff3-4d6f-ae6c-bd0d664bc345 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:49.966552 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-edb0c253-23cc-4698-8e61-af74bab90593 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:49.984400 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-edb0c253-23cc-4698-8e61-af74bab90593 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1710 microversion: 2.1 time: 0.286772 Jan 28 00:55:49.988584 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 305/632] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:49 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1710 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:50.076724 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7bd6d947-dff3-4d6f-ae6c-bd0d664bc345 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:50.086421 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7bd6d947-dff3-4d6f-ae6c-bd0d664bc345 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.272167 Jan 28 00:55:50.087010 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 328/633] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:49 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:50.355643 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d96fbd99-bdf1-4a6d-be8c-50674949f301 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:50.356667 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d96fbd99-bdf1-4a6d-be8c-50674949f301 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:50.364542 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d96fbd99-bdf1-4a6d-be8c-50674949f301 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:50.365039 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d96fbd99-bdf1-4a6d-be8c-50674949f301 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:50.365991 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d96fbd99-bdf1-4a6d-be8c-50674949f301 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:50.366507 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d96fbd99-bdf1-4a6d-be8c-50674949f301 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:50.503333 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-0cfc0b78-607e-43d6-81fe-ccff317f7481 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:50.504172 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-0cfc0b78-607e-43d6-81fe-ccff317f7481 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:50.513023 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0cfc0b78-607e-43d6-81fe-ccff317f7481 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:50.513492 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0cfc0b78-607e-43d6-81fe-ccff317f7481 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:50.515318 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0cfc0b78-607e-43d6-81fe-ccff317f7481 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:50.515797 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0cfc0b78-607e-43d6-81fe-ccff317f7481 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:50.577593 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d96fbd99-bdf1-4a6d-be8c-50674949f301 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:50.586209 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d96fbd99-bdf1-4a6d-be8c-50674949f301 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.234596 Jan 28 00:55:50.586790 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 306/634] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:50 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:50.718965 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-0cfc0b78-607e-43d6-81fe-ccff317f7481 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:50.730459 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-0cfc0b78-607e-43d6-81fe-ccff317f7481 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:50.732130 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-0cfc0b78-607e-43d6-81fe-ccff317f7481 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:50.733526 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-0cfc0b78-607e-43d6-81fe-ccff317f7481 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.233963 Jan 28 00:55:50.734126 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 329/635] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:50 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:55:51.005758 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2dd4ab4c-1713-4c6c-9b3e-b42ebfb8e818 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:51.006370 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2dd4ab4c-1713-4c6c-9b3e-b42ebfb8e818 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:51.015112 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2dd4ab4c-1713-4c6c-9b3e-b42ebfb8e818 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:51.015860 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2dd4ab4c-1713-4c6c-9b3e-b42ebfb8e818 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:51.016855 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2dd4ab4c-1713-4c6c-9b3e-b42ebfb8e818 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:51.017299 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2dd4ab4c-1713-4c6c-9b3e-b42ebfb8e818 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:51.116538 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-cf02d361-cb04-4853-bf2a-e4b2ac441850 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:51.117328 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-cf02d361-cb04-4853-bf2a-e4b2ac441850 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:51.125743 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf02d361-cb04-4853-bf2a-e4b2ac441850 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:51.128738 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf02d361-cb04-4853-bf2a-e4b2ac441850 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:51.136206 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf02d361-cb04-4853-bf2a-e4b2ac441850 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:51.137136 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf02d361-cb04-4853-bf2a-e4b2ac441850 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:51.252131 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-2dd4ab4c-1713-4c6c-9b3e-b42ebfb8e818 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:51.272828 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2dd4ab4c-1713-4c6c-9b3e-b42ebfb8e818 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1710 microversion: 2.1 time: 0.270259 Jan 28 00:55:51.273595 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 307/636] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:51 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1710 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:51.378305 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cf02d361-cb04-4853-bf2a-e4b2ac441850 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:51.397250 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-cf02d361-cb04-4853-bf2a-e4b2ac441850 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.294836 Jan 28 00:55:51.398341 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 330/637] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:51 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:51.605436 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e033d4c3-09cf-4352-bd20-e6e06730f0f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:51.606138 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e033d4c3-09cf-4352-bd20-e6e06730f0f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:51.612411 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e033d4c3-09cf-4352-bd20-e6e06730f0f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:51.612857 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e033d4c3-09cf-4352-bd20-e6e06730f0f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:51.613646 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e033d4c3-09cf-4352-bd20-e6e06730f0f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:51.614081 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e033d4c3-09cf-4352-bd20-e6e06730f0f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:51.753588 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-77a387f2-e156-409f-9376-d5bccbc31df5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:51.754201 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-77a387f2-e156-409f-9376-d5bccbc31df5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:51.760911 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-77a387f2-e156-409f-9376-d5bccbc31df5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:51.761380 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-77a387f2-e156-409f-9376-d5bccbc31df5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:51.762474 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-77a387f2-e156-409f-9376-d5bccbc31df5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:51.762934 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-77a387f2-e156-409f-9376-d5bccbc31df5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:51.844126 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e033d4c3-09cf-4352-bd20-e6e06730f0f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:51.852158 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e033d4c3-09cf-4352-bd20-e6e06730f0f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.250434 Jan 28 00:55:51.856110 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 308/638] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:51 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:51.983570 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-77a387f2-e156-409f-9376-d5bccbc31df5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:51.992864 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-77a387f2-e156-409f-9376-d5bccbc31df5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:51.994434 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-77a387f2-e156-409f-9376-d5bccbc31df5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:51.995674 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-77a387f2-e156-409f-9376-d5bccbc31df5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.246457 Jan 28 00:55:51.996256 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 331/639] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:51 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:52.296251 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7e4d623e-2808-43be-8b7a-9d1022ce6c71 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:52.296940 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7e4d623e-2808-43be-8b7a-9d1022ce6c71 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:52.318922 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7e4d623e-2808-43be-8b7a-9d1022ce6c71 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:52.320291 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7e4d623e-2808-43be-8b7a-9d1022ce6c71 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:52.321790 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7e4d623e-2808-43be-8b7a-9d1022ce6c71 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:52.322470 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7e4d623e-2808-43be-8b7a-9d1022ce6c71 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:52.415548 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-308bd462-5d98-4bd6-8136-1ace8bd5f5ff tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:52.416824 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-308bd462-5d98-4bd6-8136-1ace8bd5f5ff tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:52.438254 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-308bd462-5d98-4bd6-8136-1ace8bd5f5ff tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:52.438758 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-308bd462-5d98-4bd6-8136-1ace8bd5f5ff tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:52.439616 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-308bd462-5d98-4bd6-8136-1ace8bd5f5ff tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:52.440062 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-308bd462-5d98-4bd6-8136-1ace8bd5f5ff tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:52.600527 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7e4d623e-2808-43be-8b7a-9d1022ce6c71 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:52.611666 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7e4d623e-2808-43be-8b7a-9d1022ce6c71 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1710 microversion: 2.1 time: 0.320539 Jan 28 00:55:52.622071 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 309/640] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:52 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1710 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:52.718485 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-308bd462-5d98-4bd6-8136-1ace8bd5f5ff tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:52.740968 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-308bd462-5d98-4bd6-8136-1ace8bd5f5ff tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.323187 Jan 28 00:55:52.743450 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 332/641] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:52 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:52.869465 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b529bbb6-72fe-45a3-98f0-e30bd0339553 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:52.870284 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b529bbb6-72fe-45a3-98f0-e30bd0339553 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:52.878016 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b529bbb6-72fe-45a3-98f0-e30bd0339553 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:52.878456 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b529bbb6-72fe-45a3-98f0-e30bd0339553 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:52.879366 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b529bbb6-72fe-45a3-98f0-e30bd0339553 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:52.879863 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b529bbb6-72fe-45a3-98f0-e30bd0339553 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:53.016970 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-c606cbbb-082a-4bba-b47f-640a4a8bab37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:53.018213 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-c606cbbb-082a-4bba-b47f-640a4a8bab37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:53.026109 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c606cbbb-082a-4bba-b47f-640a4a8bab37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:53.026874 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c606cbbb-082a-4bba-b47f-640a4a8bab37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:53.027966 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c606cbbb-082a-4bba-b47f-640a4a8bab37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:53.028622 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c606cbbb-082a-4bba-b47f-640a4a8bab37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:53.055813 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b529bbb6-72fe-45a3-98f0-e30bd0339553 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:53.070343 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b529bbb6-72fe-45a3-98f0-e30bd0339553 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.204864 Jan 28 00:55:53.071391 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 310/642] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:52 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:53.221300 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c606cbbb-082a-4bba-b47f-640a4a8bab37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:53.230912 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c606cbbb-082a-4bba-b47f-640a4a8bab37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:53.232641 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c606cbbb-082a-4bba-b47f-640a4a8bab37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:53.233820 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-c606cbbb-082a-4bba-b47f-640a4a8bab37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.223750 Jan 28 00:55:53.234394 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 333/643] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:53 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:55:53.632106 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d025c987-dad1-423c-a2ed-cab131c617d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:53.632953 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d025c987-dad1-423c-a2ed-cab131c617d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:53.645980 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d025c987-dad1-423c-a2ed-cab131c617d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:53.646921 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d025c987-dad1-423c-a2ed-cab131c617d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:53.647668 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d025c987-dad1-423c-a2ed-cab131c617d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:53.648438 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d025c987-dad1-423c-a2ed-cab131c617d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:53.759264 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3f358059-5ee9-4e5f-a826-e1dae4fbd116 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:53.760337 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3f358059-5ee9-4e5f-a826-e1dae4fbd116 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:53.789115 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3f358059-5ee9-4e5f-a826-e1dae4fbd116 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:53.789714 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3f358059-5ee9-4e5f-a826-e1dae4fbd116 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:53.790766 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3f358059-5ee9-4e5f-a826-e1dae4fbd116 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:53.801195 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3f358059-5ee9-4e5f-a826-e1dae4fbd116 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:53.891775 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d025c987-dad1-423c-a2ed-cab131c617d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:53.915343 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d025c987-dad1-423c-a2ed-cab131c617d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1710 microversion: 2.1 time: 0.283926 Jan 28 00:55:53.915343 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 311/644] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:53 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1710 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:54.081841 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3f358059-5ee9-4e5f-a826-e1dae4fbd116 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:54.093493 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f1a7083e-f384-4610-9e09-db32c36ea822 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:54.094563 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f1a7083e-f384-4610-9e09-db32c36ea822 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:54.099663 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3f358059-5ee9-4e5f-a826-e1dae4fbd116 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.347944 Jan 28 00:55:54.101166 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 334/645] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:53 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:54.101760 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f1a7083e-f384-4610-9e09-db32c36ea822 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:54.102283 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f1a7083e-f384-4610-9e09-db32c36ea822 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:54.103152 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f1a7083e-f384-4610-9e09-db32c36ea822 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:54.103678 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f1a7083e-f384-4610-9e09-db32c36ea822 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:54.260894 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-45a5a35b-b8d6-4f8f-b596-7af5c2ccf663 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:54.261749 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-45a5a35b-b8d6-4f8f-b596-7af5c2ccf663 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:54.269441 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-45a5a35b-b8d6-4f8f-b596-7af5c2ccf663 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:54.269908 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-45a5a35b-b8d6-4f8f-b596-7af5c2ccf663 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:54.270720 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-45a5a35b-b8d6-4f8f-b596-7af5c2ccf663 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:54.271165 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-45a5a35b-b8d6-4f8f-b596-7af5c2ccf663 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:54.319905 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f1a7083e-f384-4610-9e09-db32c36ea822 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:54.329589 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f1a7083e-f384-4610-9e09-db32c36ea822 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.241304 Jan 28 00:55:54.329589 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 312/646] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:54 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:54.456632 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-45a5a35b-b8d6-4f8f-b596-7af5c2ccf663 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:54.465709 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-45a5a35b-b8d6-4f8f-b596-7af5c2ccf663 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:54.467812 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-45a5a35b-b8d6-4f8f-b596-7af5c2ccf663 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:54.469047 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-45a5a35b-b8d6-4f8f-b596-7af5c2ccf663 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.211908 Jan 28 00:55:54.469629 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 335/647] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:54 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:54.932581 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-84745764-57d1-4334-95dd-c3a17d25261c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:54.933180 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-84745764-57d1-4334-95dd-c3a17d25261c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:54.941652 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-84745764-57d1-4334-95dd-c3a17d25261c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:54.942238 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-84745764-57d1-4334-95dd-c3a17d25261c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:54.943225 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-84745764-57d1-4334-95dd-c3a17d25261c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:54.943862 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-84745764-57d1-4334-95dd-c3a17d25261c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:55.103643 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-84745764-57d1-4334-95dd-c3a17d25261c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:55.114126 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-84745764-57d1-4334-95dd-c3a17d25261c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1710 microversion: 2.1 time: 0.184986 Jan 28 00:55:55.114778 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 313/648] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:54 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1710 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:55.126276 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-158c0105-ac8c-4bb3-a2a4-fc5e58cd13d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:55.126905 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-158c0105-ac8c-4bb3-a2a4-fc5e58cd13d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:55.133726 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-158c0105-ac8c-4bb3-a2a4-fc5e58cd13d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:55.134187 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-158c0105-ac8c-4bb3-a2a4-fc5e58cd13d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:55.134993 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-158c0105-ac8c-4bb3-a2a4-fc5e58cd13d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:55.135484 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-158c0105-ac8c-4bb3-a2a4-fc5e58cd13d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:55.292571 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-158c0105-ac8c-4bb3-a2a4-fc5e58cd13d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:55.303415 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-158c0105-ac8c-4bb3-a2a4-fc5e58cd13d2 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.182528 Jan 28 00:55:55.304014 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 336/649] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:55 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:55.348702 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-9b46228a-34ee-435b-8a05-8b20d6c0b9e6 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:55.350369 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-9b46228a-34ee-435b-8a05-8b20d6c0b9e6 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:55.358574 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9b46228a-34ee-435b-8a05-8b20d6c0b9e6 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:55.359070 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9b46228a-34ee-435b-8a05-8b20d6c0b9e6 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:55.359921 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9b46228a-34ee-435b-8a05-8b20d6c0b9e6 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:55.360363 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9b46228a-34ee-435b-8a05-8b20d6c0b9e6 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:55.487452 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ad2aca76-8833-4937-8abe-1f363ee305cd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:55.488275 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ad2aca76-8833-4937-8abe-1f363ee305cd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:55.494462 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ad2aca76-8833-4937-8abe-1f363ee305cd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:55.497137 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ad2aca76-8833-4937-8abe-1f363ee305cd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:55.497137 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ad2aca76-8833-4937-8abe-1f363ee305cd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:55.497137 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ad2aca76-8833-4937-8abe-1f363ee305cd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:55.505340 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-9b46228a-34ee-435b-8a05-8b20d6c0b9e6 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:55.513358 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-9b46228a-34ee-435b-8a05-8b20d6c0b9e6 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.171124 Jan 28 00:55:55.514511 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 314/650] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:55 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:55.668468 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ad2aca76-8833-4937-8abe-1f363ee305cd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:55.678839 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ad2aca76-8833-4937-8abe-1f363ee305cd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:55.680888 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ad2aca76-8833-4937-8abe-1f363ee305cd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:55.682527 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ad2aca76-8833-4937-8abe-1f363ee305cd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.198811 Jan 28 00:55:55.687156 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 337/651] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:55 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:55:56.132811 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e7b82db5-79d0-4c6b-9b74-af45cbd595dc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:56.133451 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e7b82db5-79d0-4c6b-9b74-af45cbd595dc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:56.145737 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e7b82db5-79d0-4c6b-9b74-af45cbd595dc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:56.146099 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e7b82db5-79d0-4c6b-9b74-af45cbd595dc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:56.146950 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e7b82db5-79d0-4c6b-9b74-af45cbd595dc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:56.147438 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e7b82db5-79d0-4c6b-9b74-af45cbd595dc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:56.322492 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9e8f08fa-7c69-4df4-881b-c24a57938e44 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:56.324197 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9e8f08fa-7c69-4df4-881b-c24a57938e44 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:56.331430 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9e8f08fa-7c69-4df4-881b-c24a57938e44 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:56.331923 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9e8f08fa-7c69-4df4-881b-c24a57938e44 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:56.332736 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9e8f08fa-7c69-4df4-881b-c24a57938e44 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:56.333184 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9e8f08fa-7c69-4df4-881b-c24a57938e44 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:56.407820 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e7b82db5-79d0-4c6b-9b74-af45cbd595dc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:56.418324 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e7b82db5-79d0-4c6b-9b74-af45cbd595dc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1710 microversion: 2.1 time: 0.290098 Jan 28 00:55:56.419080 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 315/652] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:56 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1710 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:56.490162 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9e8f08fa-7c69-4df4-881b-c24a57938e44 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:56.501128 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9e8f08fa-7c69-4df4-881b-c24a57938e44 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.183706 Jan 28 00:55:56.502158 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 338/653] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:56 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:56.533796 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3ead2310-0cb3-443b-a8ed-1e76f593cfe0 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:56.534816 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-3ead2310-0cb3-443b-a8ed-1e76f593cfe0 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:56.544065 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3ead2310-0cb3-443b-a8ed-1e76f593cfe0 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:56.544763 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3ead2310-0cb3-443b-a8ed-1e76f593cfe0 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:56.546818 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3ead2310-0cb3-443b-a8ed-1e76f593cfe0 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:56.547616 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3ead2310-0cb3-443b-a8ed-1e76f593cfe0 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:56.695113 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-3ead2310-0cb3-443b-a8ed-1e76f593cfe0 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:56.702907 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-daee397d-2a69-4d51-8821-95f3dc228143 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:56.703566 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-daee397d-2a69-4d51-8821-95f3dc228143 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:56.704046 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3ead2310-0cb3-443b-a8ed-1e76f593cfe0 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.175514 Jan 28 00:55:56.704634 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 316/654] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:56 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:56.709866 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-daee397d-2a69-4d51-8821-95f3dc228143 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:56.710327 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-daee397d-2a69-4d51-8821-95f3dc228143 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:56.712370 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-daee397d-2a69-4d51-8821-95f3dc228143 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:56.712370 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-daee397d-2a69-4d51-8821-95f3dc228143 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:56.877104 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-daee397d-2a69-4d51-8821-95f3dc228143 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:56.887175 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-daee397d-2a69-4d51-8821-95f3dc228143 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:56.889722 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-daee397d-2a69-4d51-8821-95f3dc228143 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:56.891223 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-daee397d-2a69-4d51-8821-95f3dc228143 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.192939 Jan 28 00:55:56.891843 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 339/655] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:56 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:57.436502 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-56b157a9-d6e2-4566-b290-6a7a1e537485 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:57.437159 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-56b157a9-d6e2-4566-b290-6a7a1e537485 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:57.448595 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-56b157a9-d6e2-4566-b290-6a7a1e537485 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:57.448966 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-56b157a9-d6e2-4566-b290-6a7a1e537485 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:57.449770 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-56b157a9-d6e2-4566-b290-6a7a1e537485 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:57.450216 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-56b157a9-d6e2-4566-b290-6a7a1e537485 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:57.520459 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-af37c48c-4e47-4851-9a4a-6389e58edae0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:57.521561 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-af37c48c-4e47-4851-9a4a-6389e58edae0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:57.528763 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-af37c48c-4e47-4851-9a4a-6389e58edae0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:57.529261 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-af37c48c-4e47-4851-9a4a-6389e58edae0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:57.530870 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-af37c48c-4e47-4851-9a4a-6389e58edae0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:57.531494 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-af37c48c-4e47-4851-9a4a-6389e58edae0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:57.639096 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-56b157a9-d6e2-4566-b290-6a7a1e537485 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:57.648408 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-56b157a9-d6e2-4566-b290-6a7a1e537485 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1714 microversion: 2.1 time: 0.215712 Jan 28 00:55:57.649002 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 317/656] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:57 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1714 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:57.709467 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-af37c48c-4e47-4851-9a4a-6389e58edae0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:57.717776 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-af37c48c-4e47-4851-9a4a-6389e58edae0 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1521 microversion: 2.1 time: 0.201281 Jan 28 00:55:57.718358 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 340/657] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:57 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:57.722752 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-dd9a272e-aaf2-4ee8-95cb-8ed6458dfeb2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:57.723420 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-dd9a272e-aaf2-4ee8-95cb-8ed6458dfeb2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:57.729643 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-dd9a272e-aaf2-4ee8-95cb-8ed6458dfeb2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:57.730095 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-dd9a272e-aaf2-4ee8-95cb-8ed6458dfeb2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:57.730879 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-dd9a272e-aaf2-4ee8-95cb-8ed6458dfeb2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:57.731367 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-dd9a272e-aaf2-4ee8-95cb-8ed6458dfeb2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:57.869502 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-dd9a272e-aaf2-4ee8-95cb-8ed6458dfeb2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:57.878374 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-dd9a272e-aaf2-4ee8-95cb-8ed6458dfeb2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.161419 Jan 28 00:55:57.878957 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 318/658] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:57 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:55:57.912797 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d712714e-e91e-4ed7-9b9e-435ffb77b43e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:57.913596 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d712714e-e91e-4ed7-9b9e-435ffb77b43e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:57.919714 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d712714e-e91e-4ed7-9b9e-435ffb77b43e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:57.920254 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d712714e-e91e-4ed7-9b9e-435ffb77b43e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:57.921143 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d712714e-e91e-4ed7-9b9e-435ffb77b43e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:57.921675 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d712714e-e91e-4ed7-9b9e-435ffb77b43e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:58.067104 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d712714e-e91e-4ed7-9b9e-435ffb77b43e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:58.075694 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d712714e-e91e-4ed7-9b9e-435ffb77b43e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:58.077390 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d712714e-e91e-4ed7-9b9e-435ffb77b43e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:58.078565 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d712714e-e91e-4ed7-9b9e-435ffb77b43e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.169548 Jan 28 00:55:58.079135 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 341/659] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:57 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:55:58.285340 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-fe654f8d-fd55-422d-9104-9859ba017ba7 req-56266c8c-b437-482d-b14a-847b07d413aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35f84832-ed83-48ac-a8cb-f3a87abd47bd", "name": "network-vif-deleted", "tag": "8dcfa13b-a8cd-4dce-8441-ad8f8ab5dda8"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:55:58.287150 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:55:58.287150 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:55:58.296297 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-fe654f8d-fd55-422d-9104-9859ba017ba7 req-56266c8c-b437-482d-b14a-847b07d413aa service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:58.296778 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-fe654f8d-fd55-422d-9104-9859ba017ba7 req-56266c8c-b437-482d-b14a-847b07d413aa service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:58.308890 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-fe654f8d-fd55-422d-9104-9859ba017ba7 req-56266c8c-b437-482d-b14a-847b07d413aa service nova] Creating event network-vif-deleted:8dcfa13b-a8cd-4dce-8441-ad8f8ab5dda8 for instance 35f84832-ed83-48ac-a8cb-f3a87abd47bd on hv-cinder-80952 Jan 28 00:55:58.314758 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-fe654f8d-fd55-422d-9104-9859ba017ba7 req-56266c8c-b437-482d-b14a-847b07d413aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033322 Jan 28 00:55:58.315504 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 319/660] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:55:58.735950 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-113dac9e-ef44-414a-b5f1-92ac5f628335 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:58.736590 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-113dac9e-ef44-414a-b5f1-92ac5f628335 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:58.743378 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-113dac9e-ef44-414a-b5f1-92ac5f628335 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:58.743843 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-113dac9e-ef44-414a-b5f1-92ac5f628335 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:58.744653 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-113dac9e-ef44-414a-b5f1-92ac5f628335 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:58.745107 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-113dac9e-ef44-414a-b5f1-92ac5f628335 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:58.789177 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-113dac9e-ef44-414a-b5f1-92ac5f628335 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:58.789638 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-113dac9e-ef44-414a-b5f1-92ac5f628335 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:58.790107 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.objects.instance [None req-113dac9e-ef44-414a-b5f1-92ac5f628335 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lazy-loading 'fault' on Instance uuid 35f84832-ed83-48ac-a8cb-f3a87abd47bd {{(pid=127862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:55:58.837211 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-113dac9e-ef44-414a-b5f1-92ac5f628335 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f3c09904304ca08793fa87c8f5d61f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e31c63dec9478482118f0b8bd693c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:58.846007 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-113dac9e-ef44-414a-b5f1-92ac5f628335 tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 200 len: 1311 microversion: 2.1 time: 0.114806 Jan 28 00:55:58.846589 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 342/661] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:58 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 1311 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:58.898823 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3559d273-7628-48ad-8bc5-deb51a71201b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:58.899855 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-3559d273-7628-48ad-8bc5-deb51a71201b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:58.906718 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3559d273-7628-48ad-8bc5-deb51a71201b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:58.907164 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3559d273-7628-48ad-8bc5-deb51a71201b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:58.907998 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3559d273-7628-48ad-8bc5-deb51a71201b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:58.908435 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3559d273-7628-48ad-8bc5-deb51a71201b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:59.056609 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-3559d273-7628-48ad-8bc5-deb51a71201b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:59.065049 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3559d273-7628-48ad-8bc5-deb51a71201b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.172990 Jan 28 00:55:59.065629 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 320/662] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:58 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:55:59.100108 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-647e5b0e-c81c-4fc8-b583-a3863fe6e086 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:59.100722 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-647e5b0e-c81c-4fc8-b583-a3863fe6e086 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:59.106771 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-647e5b0e-c81c-4fc8-b583-a3863fe6e086 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:59.107225 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-647e5b0e-c81c-4fc8-b583-a3863fe6e086 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:59.108593 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-647e5b0e-c81c-4fc8-b583-a3863fe6e086 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:59.109147 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-647e5b0e-c81c-4fc8-b583-a3863fe6e086 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:59.257640 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-647e5b0e-c81c-4fc8-b583-a3863fe6e086 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:59.266997 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-647e5b0e-c81c-4fc8-b583-a3863fe6e086 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:59.268548 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-647e5b0e-c81c-4fc8-b583-a3863fe6e086 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:55:59.269745 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-647e5b0e-c81c-4fc8-b583-a3863fe6e086 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.173376 Jan 28 00:55:59.270322 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 343/663] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:55:59 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:55:59.869174 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-6cd3fbdf-a289-44c0-9c5c-9b73670196af tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:55:59.870515 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-6cd3fbdf-a289-44c0-9c5c-9b73670196af tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] [instance: 35f84832-ed83-48ac-a8cb-f3a87abd47bd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:55:59.885407 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6cd3fbdf-a289-44c0-9c5c-9b73670196af tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:59.891020 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6cd3fbdf-a289-44c0-9c5c-9b73670196af tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:59.894553 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6cd3fbdf-a289-44c0-9c5c-9b73670196af tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:55:59.894553 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6cd3fbdf-a289-44c0-9c5c-9b73670196af tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:55:59.924843 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-6cd3fbdf-a289-44c0-9c5c-9b73670196af tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] HTTP exception thrown: Instance 35f84832-ed83-48ac-a8cb-f3a87abd47bd could not be found. Jan 28 00:55:59.925885 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-6cd3fbdf-a289-44c0-9c5c-9b73670196af tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] Returning 404 to user: Instance 35f84832-ed83-48ac-a8cb-f3a87abd47bd could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:55:59.926638 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-6cd3fbdf-a289-44c0-9c5c-9b73670196af tempest-ServerRescueNegativeTestJSON-1171952210 tempest-ServerRescueNegativeTestJSON-1171952210-project] 10.222.0.25 "GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd" status: 404 len: 111 microversion: 2.1 time: 0.065553 Jan 28 00:55:59.927239 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 321/664] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:55:59 2022] GET /compute/v2.1/servers/35f84832-ed83-48ac-a8cb-f3a87abd47bd => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:56:00.082814 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7556ca24-9a3c-4038-8ba1-36837bf2fa6b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:00.083487 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7556ca24-9a3c-4038-8ba1-36837bf2fa6b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:00.090005 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7556ca24-9a3c-4038-8ba1-36837bf2fa6b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:00.090472 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7556ca24-9a3c-4038-8ba1-36837bf2fa6b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:00.091312 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7556ca24-9a3c-4038-8ba1-36837bf2fa6b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:00.092290 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7556ca24-9a3c-4038-8ba1-36837bf2fa6b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:00.255309 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7556ca24-9a3c-4038-8ba1-36837bf2fa6b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:00.263008 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7556ca24-9a3c-4038-8ba1-36837bf2fa6b tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.183874 Jan 28 00:56:00.263686 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 344/665] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:00 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:00.290926 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3070e243-11ac-4517-94af-c3d851dbb77f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:00.291574 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-3070e243-11ac-4517-94af-c3d851dbb77f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:00.298371 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3070e243-11ac-4517-94af-c3d851dbb77f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:00.298837 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3070e243-11ac-4517-94af-c3d851dbb77f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:00.299682 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3070e243-11ac-4517-94af-c3d851dbb77f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:00.300126 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3070e243-11ac-4517-94af-c3d851dbb77f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:00.470626 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-3070e243-11ac-4517-94af-c3d851dbb77f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:00.483347 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-3070e243-11ac-4517-94af-c3d851dbb77f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:00.485820 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-3070e243-11ac-4517-94af-c3d851dbb77f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:00.487065 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3070e243-11ac-4517-94af-c3d851dbb77f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.200098 Jan 28 00:56:00.487841 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 322/666] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:56:00 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:56:01.282876 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ec5a6f70-9726-45d5-b177-9fe35c2d3405 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:01.284265 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ec5a6f70-9726-45d5-b177-9fe35c2d3405 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:01.291094 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ec5a6f70-9726-45d5-b177-9fe35c2d3405 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:01.291939 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ec5a6f70-9726-45d5-b177-9fe35c2d3405 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:01.293325 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ec5a6f70-9726-45d5-b177-9fe35c2d3405 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:01.294002 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ec5a6f70-9726-45d5-b177-9fe35c2d3405 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:01.469879 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ec5a6f70-9726-45d5-b177-9fe35c2d3405 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:01.481882 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ec5a6f70-9726-45d5-b177-9fe35c2d3405 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.204262 Jan 28 00:56:01.483099 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 345/667] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:01 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:56:01.515058 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e9ae9e64-07ea-4c31-ae43-ad1dea5c285a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:01.515058 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e9ae9e64-07ea-4c31-ae43-ad1dea5c285a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:01.525131 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e9ae9e64-07ea-4c31-ae43-ad1dea5c285a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:01.525813 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e9ae9e64-07ea-4c31-ae43-ad1dea5c285a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:01.527042 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e9ae9e64-07ea-4c31-ae43-ad1dea5c285a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:01.527875 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e9ae9e64-07ea-4c31-ae43-ad1dea5c285a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:01.691153 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e9ae9e64-07ea-4c31-ae43-ad1dea5c285a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:01.706470 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e9ae9e64-07ea-4c31-ae43-ad1dea5c285a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:01.709206 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e9ae9e64-07ea-4c31-ae43-ad1dea5c285a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:01.711118 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e9ae9e64-07ea-4c31-ae43-ad1dea5c285a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.203786 Jan 28 00:56:01.712477 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 323/668] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:56:01 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:56:01.895360 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-777f0c30-62f7-48ae-9070-a640ddcff6e2 req-8fe59533-3652-448e-9b6f-a9620e2da564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "060e1452-5aba-4323-894d-a04d6aed8785", "name": "network-vif-plugged", "status": "completed", "tag": "1f359392-df9f-424a-b687-8308d8dcbece"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:56:01.897425 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:56:01.897425 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:56:01.906769 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-777f0c30-62f7-48ae-9070-a640ddcff6e2 req-8fe59533-3652-448e-9b6f-a9620e2da564 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:01.907453 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-777f0c30-62f7-48ae-9070-a640ddcff6e2 req-8fe59533-3652-448e-9b6f-a9620e2da564 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:01.920361 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-777f0c30-62f7-48ae-9070-a640ddcff6e2 req-8fe59533-3652-448e-9b6f-a9620e2da564 service nova] Creating event network-vif-plugged:1f359392-df9f-424a-b687-8308d8dcbece for instance 060e1452-5aba-4323-894d-a04d6aed8785 on hv-cinder-80952 Jan 28 00:56:01.927192 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-777f0c30-62f7-48ae-9070-a640ddcff6e2 req-8fe59533-3652-448e-9b6f-a9620e2da564 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035374 Jan 28 00:56:01.928162 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 346/669] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:56:02.499742 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-810bb5b4-c6ba-4ecc-b6b9-13c89e8d09c5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:02.500756 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-810bb5b4-c6ba-4ecc-b6b9-13c89e8d09c5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:02.507753 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-810bb5b4-c6ba-4ecc-b6b9-13c89e8d09c5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:02.508446 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-810bb5b4-c6ba-4ecc-b6b9-13c89e8d09c5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:02.509341 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-810bb5b4-c6ba-4ecc-b6b9-13c89e8d09c5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:02.509919 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-810bb5b4-c6ba-4ecc-b6b9-13c89e8d09c5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:02.669585 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-810bb5b4-c6ba-4ecc-b6b9-13c89e8d09c5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:02.682502 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-810bb5b4-c6ba-4ecc-b6b9-13c89e8d09c5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.186210 Jan 28 00:56:02.683509 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 324/670] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:02 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:02.738255 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ab0549fe-e953-4387-be16-d15a166d44dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:02.740451 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ab0549fe-e953-4387-be16-d15a166d44dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:02.746967 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ab0549fe-e953-4387-be16-d15a166d44dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:02.747789 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ab0549fe-e953-4387-be16-d15a166d44dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:02.749720 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ab0549fe-e953-4387-be16-d15a166d44dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:02.750495 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ab0549fe-e953-4387-be16-d15a166d44dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:02.956791 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ab0549fe-e953-4387-be16-d15a166d44dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:02.968813 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ab0549fe-e953-4387-be16-d15a166d44dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:02.970407 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ab0549fe-e953-4387-be16-d15a166d44dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:02.971693 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ab0549fe-e953-4387-be16-d15a166d44dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.242044 Jan 28 00:56:02.972274 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 347/671] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:56:02 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:56:03.709638 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-cef1b0e9-b0cf-45c0-b306-23c78527bdba tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:03.714707 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-cef1b0e9-b0cf-45c0-b306-23c78527bdba tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:03.727014 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cef1b0e9-b0cf-45c0-b306-23c78527bdba tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:03.727585 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cef1b0e9-b0cf-45c0-b306-23c78527bdba tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:03.728514 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cef1b0e9-b0cf-45c0-b306-23c78527bdba tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:03.728957 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cef1b0e9-b0cf-45c0-b306-23c78527bdba tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:03.910888 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-cef1b0e9-b0cf-45c0-b306-23c78527bdba tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:03.921687 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-cef1b0e9-b0cf-45c0-b306-23c78527bdba tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1358 microversion: 2.1 time: 0.220659 Jan 28 00:56:03.922286 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 325/672] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:03 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:03.990840 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9edc4632-9252-488d-a4ee-3a26d7b6b952 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:03.991491 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9edc4632-9252-488d-a4ee-3a26d7b6b952 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:04.004405 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9edc4632-9252-488d-a4ee-3a26d7b6b952 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:04.005034 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9edc4632-9252-488d-a4ee-3a26d7b6b952 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:04.006239 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9edc4632-9252-488d-a4ee-3a26d7b6b952 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:04.006702 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9edc4632-9252-488d-a4ee-3a26d7b6b952 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:04.165459 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9edc4632-9252-488d-a4ee-3a26d7b6b952 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:04.174886 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9edc4632-9252-488d-a4ee-3a26d7b6b952 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:04.176462 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9edc4632-9252-488d-a4ee-3a26d7b6b952 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:04.177719 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9edc4632-9252-488d-a4ee-3a26d7b6b952 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.190897 Jan 28 00:56:04.179405 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 348/673] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:56:03 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:56:04.939631 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7cfa9c61-d448-4535-a39d-b740bf8a9c1d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:04.940285 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7cfa9c61-d448-4535-a39d-b740bf8a9c1d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:04.946719 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7cfa9c61-d448-4535-a39d-b740bf8a9c1d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:04.947178 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7cfa9c61-d448-4535-a39d-b740bf8a9c1d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:04.948118 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7cfa9c61-d448-4535-a39d-b740bf8a9c1d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:04.948453 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7cfa9c61-d448-4535-a39d-b740bf8a9c1d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:05.098425 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7cfa9c61-d448-4535-a39d-b740bf8a9c1d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:05.106263 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7cfa9c61-d448-4535-a39d-b740bf8a9c1d tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1548 microversion: 2.1 time: 0.171130 Jan 28 00:56:05.106846 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 326/674] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:04 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:56:05.124903 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-00f54901-6f18-4c21-99b1-32b3bba0d914 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:05.125532 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-00f54901-6f18-4c21-99b1-32b3bba0d914 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:05.132471 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-00f54901-6f18-4c21-99b1-32b3bba0d914 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:05.132958 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-00f54901-6f18-4c21-99b1-32b3bba0d914 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:05.133783 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-00f54901-6f18-4c21-99b1-32b3bba0d914 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:05.134342 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-00f54901-6f18-4c21-99b1-32b3bba0d914 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:05.196162 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5f4c3c54-60db-48c4-b006-1c75504778ee tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:05.197129 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5f4c3c54-60db-48c4-b006-1c75504778ee tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:05.204491 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5f4c3c54-60db-48c4-b006-1c75504778ee tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:05.205088 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5f4c3c54-60db-48c4-b006-1c75504778ee tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:05.205900 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5f4c3c54-60db-48c4-b006-1c75504778ee tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:05.206386 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5f4c3c54-60db-48c4-b006-1c75504778ee tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:05.326056 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-00f54901-6f18-4c21-99b1-32b3bba0d914 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:05.335157 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-00f54901-6f18-4c21-99b1-32b3bba0d914 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1548 microversion: 2.1 time: 0.214864 Jan 28 00:56:05.335791 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 349/675] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:05 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1548 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:05.354078 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4c6de4a7-a987-43d7-9fc3-750f355786de tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:05.358154 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:56:05.358154 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:56:05.359458 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4c6de4a7-a987-43d7-9fc3-750f355786de tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:05.360332 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4c6de4a7-a987-43d7-9fc3-750f355786de tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Searching by: {'deleted': False, 'project_id': '2dc8dc67a706412e8404052725053540'} {{(pid=127862) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 28 00:56:05.367167 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c6de4a7-a987-43d7-9fc3-750f355786de tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:05.367737 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c6de4a7-a987-43d7-9fc3-750f355786de tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:05.368628 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c6de4a7-a987-43d7-9fc3-750f355786de tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:05.369255 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c6de4a7-a987-43d7-9fc3-750f355786de tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:05.404969 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-5f4c3c54-60db-48c4-b006-1c75504778ee tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:05.414717 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-5f4c3c54-60db-48c4-b006-1c75504778ee tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:05.416590 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-5f4c3c54-60db-48c4-b006-1c75504778ee tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:05.417842 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5f4c3c54-60db-48c4-b006-1c75504778ee tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.225457 Jan 28 00:56:05.418485 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 327/676] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:56:05 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:56:05.470923 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.multi_cell_list [None req-4c6de4a7-a987-43d7-9fc3-750f355786de tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127862) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 28 00:56:05.569303 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4c6de4a7-a987-43d7-9fc3-750f355786de tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.218793 Jan 28 00:56:05.570100 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 350/677] 10.222.0.25 () {58 vars in 1124 bytes} [Fri Jan 28 00:56:05 2022] GET /compute/v2.1/servers => generated 342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:56:05.581057 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ad52f3e4-33e3-4e48-a077-d699eb695a6f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:05.581682 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ad52f3e4-33e3-4e48-a077-d699eb695a6f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:05.587724 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ad52f3e4-33e3-4e48-a077-d699eb695a6f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:05.588187 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ad52f3e4-33e3-4e48-a077-d699eb695a6f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:05.589000 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ad52f3e4-33e3-4e48-a077-d699eb695a6f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:05.589440 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ad52f3e4-33e3-4e48-a077-d699eb695a6f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:05.737473 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-ad52f3e4-33e3-4e48-a077-d699eb695a6f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:05.747671 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ad52f3e4-33e3-4e48-a077-d699eb695a6f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1548 microversion: 2.1 time: 0.171262 Jan 28 00:56:05.754882 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 328/678] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:05 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1548 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:05.955036 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-bb87a804-d9d8-41c2-9d94-9d1c3cbbd281 req-dd31d647-8a72-4807-b6fe-5b51aa3bb262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4", "name": "network-vif-plugged", "status": "completed", "tag": "83fc2ec7-8030-466d-ac4d-dc369ac1f250"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:56:05.957038 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:56:05.957038 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:56:05.971876 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-bb87a804-d9d8-41c2-9d94-9d1c3cbbd281 req-dd31d647-8a72-4807-b6fe-5b51aa3bb262 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:05.972683 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-bb87a804-d9d8-41c2-9d94-9d1c3cbbd281 req-dd31d647-8a72-4807-b6fe-5b51aa3bb262 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:05.988661 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-bb87a804-d9d8-41c2-9d94-9d1c3cbbd281 req-dd31d647-8a72-4807-b6fe-5b51aa3bb262 service nova] Creating event network-vif-plugged:83fc2ec7-8030-466d-ac4d-dc369ac1f250 for instance 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 on hv-cinder-80952 Jan 28 00:56:05.995027 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-bb87a804-d9d8-41c2-9d94-9d1c3cbbd281 req-dd31d647-8a72-4807-b6fe-5b51aa3bb262 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044231 Jan 28 00:56:05.996440 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 351/679] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:56:06.436985 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-dc37b71d-9f62-412e-92a9-9cd6ee63f3da tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:06.437597 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-dc37b71d-9f62-412e-92a9-9cd6ee63f3da tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:06.445902 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-dc37b71d-9f62-412e-92a9-9cd6ee63f3da tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:06.446359 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-dc37b71d-9f62-412e-92a9-9cd6ee63f3da tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:06.447197 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-dc37b71d-9f62-412e-92a9-9cd6ee63f3da tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:06.447678 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-dc37b71d-9f62-412e-92a9-9cd6ee63f3da tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:06.600655 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-dc37b71d-9f62-412e-92a9-9cd6ee63f3da tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:06.612934 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-dc37b71d-9f62-412e-92a9-9cd6ee63f3da tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:06.614922 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-dc37b71d-9f62-412e-92a9-9cd6ee63f3da tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:06.616458 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-dc37b71d-9f62-412e-92a9-9cd6ee63f3da tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.183306 Jan 28 00:56:06.617218 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 329/680] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:56:06 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:56:07.392123 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-b896f4bf-e3cc-40a6-a226-5c78be68dbb8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b804850-37bf-465e-88ad-c55c312ceee1"}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:56:07.393457 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-b896f4bf-e3cc-40a6-a226-5c78be68dbb8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:07.399897 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b896f4bf-e3cc-40a6-a226-5c78be68dbb8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:07.400357 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b896f4bf-e3cc-40a6-a226-5c78be68dbb8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:07.401162 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b896f4bf-e3cc-40a6-a226-5c78be68dbb8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:07.401607 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b896f4bf-e3cc-40a6-a226-5c78be68dbb8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:07.636426 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-98ffa7a2-9d89-49ce-a7a5-5631fad6a624 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:07.637605 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-98ffa7a2-9d89-49ce-a7a5-5631fad6a624 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:07.644662 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-98ffa7a2-9d89-49ce-a7a5-5631fad6a624 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:07.645131 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-98ffa7a2-9d89-49ce-a7a5-5631fad6a624 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:07.645911 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-98ffa7a2-9d89-49ce-a7a5-5631fad6a624 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:07.646358 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-98ffa7a2-9d89-49ce-a7a5-5631fad6a624 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:07.694743 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-b896f4bf-e3cc-40a6-a226-5c78be68dbb8 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "POST /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308453 Jan 28 00:56:07.695739 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 352/681] 10.222.0.25 () {60 vars in 1322 bytes} [Fri Jan 28 00:56:07 2022] POST /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:56:07.800295 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-98ffa7a2-9d89-49ce-a7a5-5631fad6a624 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:07.808607 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-98ffa7a2-9d89-49ce-a7a5-5631fad6a624 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:07.811180 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-98ffa7a2-9d89-49ce-a7a5-5631fad6a624 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:07.812490 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-98ffa7a2-9d89-49ce-a7a5-5631fad6a624 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.180665 Jan 28 00:56:07.813056 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 330/682] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:56:07 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:56:08.831101 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-07451481-1418-4296-9794-c0c668cf1c37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:08.831713 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-07451481-1418-4296-9794-c0c668cf1c37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:08.838132 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-07451481-1418-4296-9794-c0c668cf1c37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:08.838587 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-07451481-1418-4296-9794-c0c668cf1c37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:08.839418 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-07451481-1418-4296-9794-c0c668cf1c37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:08.839868 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-07451481-1418-4296-9794-c0c668cf1c37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:09.003074 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-07451481-1418-4296-9794-c0c668cf1c37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:09.013202 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-07451481-1418-4296-9794-c0c668cf1c37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:09.015879 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-07451481-1418-4296-9794-c0c668cf1c37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:09.017182 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-07451481-1418-4296-9794-c0c668cf1c37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1808 microversion: 2.20 time: 0.190763 Jan 28 00:56:09.017764 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 353/683] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:56:08 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:56:10.036783 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5910bec0-2547-4e74-9c2a-b3a96486d75a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:10.037393 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5910bec0-2547-4e74-9c2a-b3a96486d75a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:10.044045 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5910bec0-2547-4e74-9c2a-b3a96486d75a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:10.044495 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5910bec0-2547-4e74-9c2a-b3a96486d75a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:10.045984 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5910bec0-2547-4e74-9c2a-b3a96486d75a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:10.046422 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5910bec0-2547-4e74-9c2a-b3a96486d75a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:10.184971 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-5910bec0-2547-4e74-9c2a-b3a96486d75a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:10.193606 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-5910bec0-2547-4e74-9c2a-b3a96486d75a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:10.195123 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-5910bec0-2547-4e74-9c2a-b3a96486d75a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:10.196330 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5910bec0-2547-4e74-9c2a-b3a96486d75a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1795 microversion: 2.20 time: 0.163321 Jan 28 00:56:10.196895 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 331/684] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:56:10 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1795 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:56:15.243229 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-32d7db73-af01-40c1-bc87-960fa88b1360 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:15.243873 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-32d7db73-af01-40c1-bc87-960fa88b1360 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:15.250898 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-32d7db73-af01-40c1-bc87-960fa88b1360 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:15.251392 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-32d7db73-af01-40c1-bc87-960fa88b1360 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:15.252192 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-32d7db73-af01-40c1-bc87-960fa88b1360 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:15.252668 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-32d7db73-af01-40c1-bc87-960fa88b1360 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:15.385907 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-32d7db73-af01-40c1-bc87-960fa88b1360 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:15.394639 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-32d7db73-af01-40c1-bc87-960fa88b1360 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1594 microversion: 2.1 time: 0.155065 Jan 28 00:56:15.395145 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 354/685] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:15 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:17.615099 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-d910a6ce-f001-44c0-8242-02822f7e045c req-e9fd88eb-7675-430a-b8a2-1573c4673081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "060e1452-5aba-4323-894d-a04d6aed8785", "tag": "1f359392-df9f-424a-b687-8308d8dcbece"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:56:17.617606 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:56:17.617606 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:56:17.626649 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-d910a6ce-f001-44c0-8242-02822f7e045c req-e9fd88eb-7675-430a-b8a2-1573c4673081 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:17.627590 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-d910a6ce-f001-44c0-8242-02822f7e045c req-e9fd88eb-7675-430a-b8a2-1573c4673081 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:17.640380 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-d910a6ce-f001-44c0-8242-02822f7e045c req-e9fd88eb-7675-430a-b8a2-1573c4673081 service nova] Creating event network-changed:1f359392-df9f-424a-b687-8308d8dcbece for instance 060e1452-5aba-4323-894d-a04d6aed8785 on hv-cinder-80952 Jan 28 00:56:17.647547 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-d910a6ce-f001-44c0-8242-02822f7e045c req-e9fd88eb-7675-430a-b8a2-1573c4673081 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038333 Jan 28 00:56:17.648431 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 332/686] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:56:19.021533 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-28317533-3526-41c6-99fe-287056b67d02 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-74325339"}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:56:19.022273 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-28317533-3526-41c6-99fe-287056b67d02 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:19.029678 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-28317533-3526-41c6-99fe-287056b67d02 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:19.030146 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-28317533-3526-41c6-99fe-287056b67d02 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:19.030951 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-28317533-3526-41c6-99fe-287056b67d02 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:19.031429 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-28317533-3526-41c6-99fe-287056b67d02 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:19.238930 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.network.security_group_api [None req-28317533-3526-41c6-99fe-287056b67d02 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Adding security group abaaa437-af46-4323-aff7-2b12df14201e to port 1f359392-df9f-424a-b687-8308d8dcbece Jan 28 00:56:19.926707 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-28317533-3526-41c6-99fe-287056b67d02 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "POST /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785/action" status: 202 len: 0 microversion: 2.1 time: 0.911567 Jan 28 00:56:19.928982 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 355/687] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:56:19 2022] POST /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785/action => generated 0 bytes in 916 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:56:19.941712 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-47e2f930-00c2-41d7-b003-0ff52779f691 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:19.942965 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-47e2f930-00c2-41d7-b003-0ff52779f691 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:19.945665 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-7559bd16-fc16-4d15-bcd4-7672e150fb11 req-f3ff5c14-61f5-418d-b947-750324eac015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "060e1452-5aba-4323-894d-a04d6aed8785", "tag": "1f359392-df9f-424a-b687-8308d8dcbece"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:56:19.947935 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:56:19.947935 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:56:19.957093 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-47e2f930-00c2-41d7-b003-0ff52779f691 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:19.960328 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-7559bd16-fc16-4d15-bcd4-7672e150fb11 req-f3ff5c14-61f5-418d-b947-750324eac015 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:19.961134 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-47e2f930-00c2-41d7-b003-0ff52779f691 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:19.961299 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-7559bd16-fc16-4d15-bcd4-7672e150fb11 req-f3ff5c14-61f5-418d-b947-750324eac015 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:19.964465 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-47e2f930-00c2-41d7-b003-0ff52779f691 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:19.965281 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-47e2f930-00c2-41d7-b003-0ff52779f691 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:19.990202 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-7559bd16-fc16-4d15-bcd4-7672e150fb11 req-f3ff5c14-61f5-418d-b947-750324eac015 service nova] Creating event network-changed:1f359392-df9f-424a-b687-8308d8dcbece for instance 060e1452-5aba-4323-894d-a04d6aed8785 on hv-cinder-80952 Jan 28 00:56:19.998882 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-7559bd16-fc16-4d15-bcd4-7672e150fb11 req-f3ff5c14-61f5-418d-b947-750324eac015 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057464 Jan 28 00:56:19.999879 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 356/688] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:56:20.218970 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-47e2f930-00c2-41d7-b003-0ff52779f691 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:20.229098 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-47e2f930-00c2-41d7-b003-0ff52779f691 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1757 microversion: 2.1 time: 0.295057 Jan 28 00:56:20.230650 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 333/689] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:19 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1757 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:28.390369 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 00:56:28.391046 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: Fri Jan 28 00:56:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 00:56:42.931226 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-be9fc719-f09e-4fe2-a2ce-847c489024c7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:42.931905 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-be9fc719-f09e-4fe2-a2ce-847c489024c7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:42.938833 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-be9fc719-f09e-4fe2-a2ce-847c489024c7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:42.939359 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-be9fc719-f09e-4fe2-a2ce-847c489024c7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:42.940123 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-be9fc719-f09e-4fe2-a2ce-847c489024c7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:42.940642 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-be9fc719-f09e-4fe2-a2ce-847c489024c7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:43.132390 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.objects.instance [None req-be9fc719-f09e-4fe2-a2ce-847c489024c7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lazy-loading 'services' on Instance uuid a4dbbfd4-609c-4041-b0b5-b939f759eecd {{(pid=127862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:56:43.207765 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-be9fc719-f09e-4fe2-a2ce-847c489024c7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/os-volume_attachments/aa2fe297-b26a-410a-aa3a-67b43ce829b8" status: 202 len: 0 microversion: 2.1 time: 0.281102 Jan 28 00:56:43.208397 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 357/690] 10.222.0.25 () {58 vars in 1415 bytes} [Fri Jan 28 00:56:42 2022] DELETE /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/os-volume_attachments/aa2fe297-b26a-410a-aa3a-67b43ce829b8 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:56:43.586067 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 00:56:43.586614 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: Fri Jan 28 00:56:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 00:56:45.375539 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d527ed34-e5ee-4f45-a696-a706ed6be79d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:56:45.382272 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d527ed34-e5ee-4f45-a696-a706ed6be79d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:45.382687 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d527ed34-e5ee-4f45-a696-a706ed6be79d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:45.405823 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d527ed34-e5ee-4f45-a696-a706ed6be79d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Going to try to stop instance {{(pid=127863) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 28 00:56:45.450290 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d527ed34-e5ee-4f45-a696-a706ed6be79d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 202 len: 0 microversion: 2.1 time: 0.078984 Jan 28 00:56:45.451768 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 334/691] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:56:45 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:56:45.461359 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3a28120c-6de9-4172-b75b-e93f4cf980bf tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:45.462838 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3a28120c-6de9-4172-b75b-e93f4cf980bf tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:45.471032 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3a28120c-6de9-4172-b75b-e93f4cf980bf tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:45.472497 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3a28120c-6de9-4172-b75b-e93f4cf980bf tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:45.473333 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3a28120c-6de9-4172-b75b-e93f4cf980bf tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:45.473792 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3a28120c-6de9-4172-b75b-e93f4cf980bf tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:45.701240 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3a28120c-6de9-4172-b75b-e93f4cf980bf tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:45.711509 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3a28120c-6de9-4172-b75b-e93f4cf980bf tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1678 microversion: 2.1 time: 0.255383 Jan 28 00:56:45.712519 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 358/692] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:45 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1678 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:46.732387 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2cc57a1f-a5ef-4ea7-8d55-9574728aad02 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:46.732387 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2cc57a1f-a5ef-4ea7-8d55-9574728aad02 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:46.738424 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2cc57a1f-a5ef-4ea7-8d55-9574728aad02 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:46.738882 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2cc57a1f-a5ef-4ea7-8d55-9574728aad02 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:46.739869 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2cc57a1f-a5ef-4ea7-8d55-9574728aad02 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:46.740314 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2cc57a1f-a5ef-4ea7-8d55-9574728aad02 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:47.055510 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-2cc57a1f-a5ef-4ea7-8d55-9574728aad02 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:47.063163 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2cc57a1f-a5ef-4ea7-8d55-9574728aad02 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1678 microversion: 2.1 time: 0.336791 Jan 28 00:56:47.063774 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 335/693] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:46 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1678 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:56:48.081200 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-cae2d4a0-2c20-477c-af34-56d7c08c4d1d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:48.081818 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-cae2d4a0-2c20-477c-af34-56d7c08c4d1d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:48.088218 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cae2d4a0-2c20-477c-af34-56d7c08c4d1d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:48.088680 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cae2d4a0-2c20-477c-af34-56d7c08c4d1d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:48.089486 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cae2d4a0-2c20-477c-af34-56d7c08c4d1d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:48.089933 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cae2d4a0-2c20-477c-af34-56d7c08c4d1d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:48.220367 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cae2d4a0-2c20-477c-af34-56d7c08c4d1d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:48.227703 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-cae2d4a0-2c20-477c-af34-56d7c08c4d1d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1678 microversion: 2.1 time: 0.150409 Jan 28 00:56:48.228277 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 359/694] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:48 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:49.245460 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-9e86a74d-16e4-4146-861a-6ab70d056796 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:49.246074 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-9e86a74d-16e4-4146-861a-6ab70d056796 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:49.253459 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9e86a74d-16e4-4146-861a-6ab70d056796 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:49.253891 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9e86a74d-16e4-4146-861a-6ab70d056796 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:49.254678 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9e86a74d-16e4-4146-861a-6ab70d056796 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:49.255113 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9e86a74d-16e4-4146-861a-6ab70d056796 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:49.402437 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-9e86a74d-16e4-4146-861a-6ab70d056796 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:49.409947 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-9e86a74d-16e4-4146-861a-6ab70d056796 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1678 microversion: 2.1 time: 0.168411 Jan 28 00:56:49.410514 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 336/695] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:49 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:50.426802 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-fe7c03ea-31ae-45c7-a20d-7bfa6d9792f3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:50.428176 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-fe7c03ea-31ae-45c7-a20d-7bfa6d9792f3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:50.435366 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fe7c03ea-31ae-45c7-a20d-7bfa6d9792f3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:50.435502 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fe7c03ea-31ae-45c7-a20d-7bfa6d9792f3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:50.436413 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fe7c03ea-31ae-45c7-a20d-7bfa6d9792f3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:50.436930 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fe7c03ea-31ae-45c7-a20d-7bfa6d9792f3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:50.575571 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-fe7c03ea-31ae-45c7-a20d-7bfa6d9792f3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:50.583076 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-fe7c03ea-31ae-45c7-a20d-7bfa6d9792f3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1678 microversion: 2.1 time: 0.160302 Jan 28 00:56:50.583757 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 360/696] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:50 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:51.600880 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-bc7a2198-b26f-4f8d-9b73-328dc43ef00a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:51.601496 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-bc7a2198-b26f-4f8d-9b73-328dc43ef00a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:51.609217 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bc7a2198-b26f-4f8d-9b73-328dc43ef00a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:51.609618 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bc7a2198-b26f-4f8d-9b73-328dc43ef00a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:51.610426 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bc7a2198-b26f-4f8d-9b73-328dc43ef00a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:51.610872 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bc7a2198-b26f-4f8d-9b73-328dc43ef00a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:51.754991 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-bc7a2198-b26f-4f8d-9b73-328dc43ef00a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:51.765207 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-bc7a2198-b26f-4f8d-9b73-328dc43ef00a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1678 microversion: 2.1 time: 0.167312 Jan 28 00:56:51.765998 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 337/697] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:51 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:52.242693 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1f93bb5e-7001-4588-a5f6-1ffbd2d47718 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:52.243214 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1f93bb5e-7001-4588-a5f6-1ffbd2d47718 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:52.249621 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1f93bb5e-7001-4588-a5f6-1ffbd2d47718 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:52.250087 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1f93bb5e-7001-4588-a5f6-1ffbd2d47718 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:52.250895 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1f93bb5e-7001-4588-a5f6-1ffbd2d47718 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:52.251487 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1f93bb5e-7001-4588-a5f6-1ffbd2d47718 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:52.284383 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1f93bb5e-7001-4588-a5f6-1ffbd2d47718 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/os-volume_attachments/d210f2c9-90d1-4ccb-a202-31e2631bdab7" status: 200 len: 194 microversion: 2.20 time: 0.229164 Jan 28 00:56:52.285185 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 361/698] 10.222.0.25 () {60 vars in 1453 bytes} [Fri Jan 28 00:56:52 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/os-volume_attachments/d210f2c9-90d1-4ccb-a202-31e2631bdab7 => generated 194 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:56:52.352129 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2aaa4f61-247b-496e-9510-76209f93bdf3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:52.352628 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2aaa4f61-247b-496e-9510-76209f93bdf3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:52.359023 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2aaa4f61-247b-496e-9510-76209f93bdf3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:52.359508 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2aaa4f61-247b-496e-9510-76209f93bdf3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:52.360304 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2aaa4f61-247b-496e-9510-76209f93bdf3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:52.360743 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2aaa4f61-247b-496e-9510-76209f93bdf3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:52.452663 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.objects.instance [None req-2aaa4f61-247b-496e-9510-76209f93bdf3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lazy-loading 'services' on Instance uuid 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 {{(pid=127863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:56:52.505420 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d44eaf1d-2ce1-4e98-9515-503086b8bec5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:56:52.505959 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d44eaf1d-2ce1-4e98-9515-503086b8bec5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:52.512347 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d44eaf1d-2ce1-4e98-9515-503086b8bec5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:52.512813 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d44eaf1d-2ce1-4e98-9515-503086b8bec5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:52.514465 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d44eaf1d-2ce1-4e98-9515-503086b8bec5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:52.515117 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d44eaf1d-2ce1-4e98-9515-503086b8bec5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:52.579527 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2aaa4f61-247b-496e-9510-76209f93bdf3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "DELETE /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/os-volume_attachments/d210f2c9-90d1-4ccb-a202-31e2631bdab7" status: 202 len: 0 microversion: 2.20 time: 0.230850 Jan 28 00:56:52.580235 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 338/699] 10.222.0.25 () {60 vars in 1456 bytes} [Fri Jan 28 00:56:52 2022] DELETE /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/os-volume_attachments/d210f2c9-90d1-4ccb-a202-31e2631bdab7 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 00:56:52.589035 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7f7c96cb-9678-4aff-82b8-f4ce2339facb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:52.590096 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7f7c96cb-9678-4aff-82b8-f4ce2339facb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:52.596806 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7f7c96cb-9678-4aff-82b8-f4ce2339facb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:52.597519 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7f7c96cb-9678-4aff-82b8-f4ce2339facb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:52.598128 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7f7c96cb-9678-4aff-82b8-f4ce2339facb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:52.598558 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7f7c96cb-9678-4aff-82b8-f4ce2339facb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:52.600769 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d44eaf1d-2ce1-4e98-9515-503086b8bec5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "POST /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785/action" status: 202 len: 0 microversion: 2.1 time: 0.099267 Jan 28 00:56:52.603472 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 362/700] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:56:52 2022] POST /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:56:52.611195 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7ebf76ec-181d-4224-afb7-e2291a289a58 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:52.612061 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7ebf76ec-181d-4224-afb7-e2291a289a58 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:52.618651 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7ebf76ec-181d-4224-afb7-e2291a289a58 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:52.619398 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7ebf76ec-181d-4224-afb7-e2291a289a58 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:52.620215 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7ebf76ec-181d-4224-afb7-e2291a289a58 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:52.620763 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7ebf76ec-181d-4224-afb7-e2291a289a58 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:52.645023 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7f7c96cb-9678-4aff-82b8-f4ce2339facb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060291 Jan 28 00:56:52.646155 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 339/701] 10.222.0.25 () {60 vars in 1342 bytes} [Fri Jan 28 00:56:52 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:56:52.781736 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-477a1331-70de-4626-83c1-9e8085245970 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:52.788920 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7ebf76ec-181d-4224-afb7-e2291a289a58 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:52.790231 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-477a1331-70de-4626-83c1-9e8085245970 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:52.797037 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-477a1331-70de-4626-83c1-9e8085245970 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:52.797669 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-477a1331-70de-4626-83c1-9e8085245970 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:52.798595 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-477a1331-70de-4626-83c1-9e8085245970 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:52.798709 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7ebf76ec-181d-4224-afb7-e2291a289a58 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1749 microversion: 2.1 time: 0.192227 Jan 28 00:56:52.799232 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-477a1331-70de-4626-83c1-9e8085245970 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:52.799568 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 363/702] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:52 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1749 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:56:52.938110 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-477a1331-70de-4626-83c1-9e8085245970 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:52.945672 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-477a1331-70de-4626-83c1-9e8085245970 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1678 microversion: 2.1 time: 0.167706 Jan 28 00:56:52.946244 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 340/703] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:52 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:53.658203 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d0a17db5-a6ae-439f-aa7a-7c88ca4c09fb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:53.659231 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d0a17db5-a6ae-439f-aa7a-7c88ca4c09fb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:53.666065 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d0a17db5-a6ae-439f-aa7a-7c88ca4c09fb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:53.666574 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d0a17db5-a6ae-439f-aa7a-7c88ca4c09fb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:53.667499 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d0a17db5-a6ae-439f-aa7a-7c88ca4c09fb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:53.672632 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d0a17db5-a6ae-439f-aa7a-7c88ca4c09fb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:53.701650 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d0a17db5-a6ae-439f-aa7a-7c88ca4c09fb tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047815 Jan 28 00:56:53.702396 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 364/704] 10.222.0.25 () {60 vars in 1342 bytes} [Fri Jan 28 00:56:53 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:56:53.817246 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-206073cc-8ce1-41e8-974e-f30498bb14ba tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:53.817873 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-206073cc-8ce1-41e8-974e-f30498bb14ba tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:53.824483 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-206073cc-8ce1-41e8-974e-f30498bb14ba tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:53.824845 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-206073cc-8ce1-41e8-974e-f30498bb14ba tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:53.825681 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-206073cc-8ce1-41e8-974e-f30498bb14ba tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:53.826122 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-206073cc-8ce1-41e8-974e-f30498bb14ba tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:53.963146 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3b65f077-fefb-4171-b3f4-07b2b9db994c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:53.963806 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3b65f077-fefb-4171-b3f4-07b2b9db994c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:53.970777 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3b65f077-fefb-4171-b3f4-07b2b9db994c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:53.971251 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3b65f077-fefb-4171-b3f4-07b2b9db994c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:53.972094 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3b65f077-fefb-4171-b3f4-07b2b9db994c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:53.972544 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3b65f077-fefb-4171-b3f4-07b2b9db994c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:53.985729 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-206073cc-8ce1-41e8-974e-f30498bb14ba tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:53.994091 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-206073cc-8ce1-41e8-974e-f30498bb14ba tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1754 microversion: 2.1 time: 0.180813 Jan 28 00:56:53.994678 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 341/705] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:53 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:54.109271 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3b65f077-fefb-4171-b3f4-07b2b9db994c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:54.116737 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3b65f077-fefb-4171-b3f4-07b2b9db994c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1678 microversion: 2.1 time: 0.157296 Jan 28 00:56:54.117323 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 365/706] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:53 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:56:54.718358 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f3e5d11b-b498-4415-b170-9860c1699a64 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:54.720042 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f3e5d11b-b498-4415-b170-9860c1699a64 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:54.730665 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f3e5d11b-b498-4415-b170-9860c1699a64 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:54.731501 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f3e5d11b-b498-4415-b170-9860c1699a64 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:54.732997 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f3e5d11b-b498-4415-b170-9860c1699a64 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:54.733772 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f3e5d11b-b498-4415-b170-9860c1699a64 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:54.770398 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f3e5d11b-b498-4415-b170-9860c1699a64 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060267 Jan 28 00:56:54.770972 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 342/707] 10.222.0.25 () {60 vars in 1342 bytes} [Fri Jan 28 00:56:54 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:54.831031 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-283d38cd-1459-44f4-8e1c-9552f0d26d65 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:54.832091 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-283d38cd-1459-44f4-8e1c-9552f0d26d65 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:54.839093 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-283d38cd-1459-44f4-8e1c-9552f0d26d65 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:54.839597 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-283d38cd-1459-44f4-8e1c-9552f0d26d65 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:54.840405 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-283d38cd-1459-44f4-8e1c-9552f0d26d65 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:54.840887 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-283d38cd-1459-44f4-8e1c-9552f0d26d65 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:54.875116 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-283d38cd-1459-44f4-8e1c-9552f0d26d65 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Going to try to terminate instance {{(pid=127862) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 00:56:54.968578 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-283d38cd-1459-44f4-8e1c-9552f0d26d65 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "DELETE /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 204 len: 0 microversion: 2.20 time: 0.141991 Jan 28 00:56:54.969106 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 366/708] 10.222.0.25 () {60 vars in 1279 bytes} [Fri Jan 28 00:56:54 2022] DELETE /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 00:56:54.982677 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4f4516f5-0e8c-408f-8d1e-dfd908d608b5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:54.983357 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4f4516f5-0e8c-408f-8d1e-dfd908d608b5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:54.990240 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f4516f5-0e8c-408f-8d1e-dfd908d608b5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:54.990687 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f4516f5-0e8c-408f-8d1e-dfd908d608b5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:54.991524 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f4516f5-0e8c-408f-8d1e-dfd908d608b5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:54.992254 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f4516f5-0e8c-408f-8d1e-dfd908d608b5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:55.012539 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d79a61cf-1160-4060-be55-2c02991d61d4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:55.014450 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d79a61cf-1160-4060-be55-2c02991d61d4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:55.020997 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d79a61cf-1160-4060-be55-2c02991d61d4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:55.021463 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d79a61cf-1160-4060-be55-2c02991d61d4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:55.022286 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d79a61cf-1160-4060-be55-2c02991d61d4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:55.022742 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d79a61cf-1160-4060-be55-2c02991d61d4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:55.212687 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4f4516f5-0e8c-408f-8d1e-dfd908d608b5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:55.221061 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4f4516f5-0e8c-408f-8d1e-dfd908d608b5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:55.222507 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4f4516f5-0e8c-408f-8d1e-dfd908d608b5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:55.223768 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4f4516f5-0e8c-408f-8d1e-dfd908d608b5 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.246726 Jan 28 00:56:55.225437 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 343/709] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:56:54 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:56:55.228917 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-6d100c87-562e-40bc-919b-cef3611927ba tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:55.229758 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-6d100c87-562e-40bc-919b-cef3611927ba tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:55.236541 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6d100c87-562e-40bc-919b-cef3611927ba tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:55.236991 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6d100c87-562e-40bc-919b-cef3611927ba tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:55.237796 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6d100c87-562e-40bc-919b-cef3611927ba tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:55.238233 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6d100c87-562e-40bc-919b-cef3611927ba tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:55.239810 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d79a61cf-1160-4060-be55-2c02991d61d4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:55.250962 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d79a61cf-1160-4060-be55-2c02991d61d4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1754 microversion: 2.1 time: 0.242540 Jan 28 00:56:55.251585 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 367/710] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:55 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1754 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:56:55.378350 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-6d100c87-562e-40bc-919b-cef3611927ba tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:55.385955 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-6d100c87-562e-40bc-919b-cef3611927ba tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1678 microversion: 2.1 time: 0.160630 Jan 28 00:56:55.386522 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 344/711] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:55 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:56.243285 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-cf6a4e1e-5e29-4324-8c0c-5e6bb08af6b3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:56.243991 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-cf6a4e1e-5e29-4324-8c0c-5e6bb08af6b3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:56.251794 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf6a4e1e-5e29-4324-8c0c-5e6bb08af6b3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:56.252257 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf6a4e1e-5e29-4324-8c0c-5e6bb08af6b3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:56.253065 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf6a4e1e-5e29-4324-8c0c-5e6bb08af6b3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:56.253515 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf6a4e1e-5e29-4324-8c0c-5e6bb08af6b3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:56.269272 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-95601561-7fc5-4899-8274-2858c0a1895a tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:56.270392 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-95601561-7fc5-4899-8274-2858c0a1895a tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:56.279168 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-95601561-7fc5-4899-8274-2858c0a1895a tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:56.279788 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-95601561-7fc5-4899-8274-2858c0a1895a tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:56.280723 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-95601561-7fc5-4899-8274-2858c0a1895a tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:56.281318 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-95601561-7fc5-4899-8274-2858c0a1895a tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:56.480415 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cf6a4e1e-5e29-4324-8c0c-5e6bb08af6b3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:56.490489 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cf6a4e1e-5e29-4324-8c0c-5e6bb08af6b3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:56.492382 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cf6a4e1e-5e29-4324-8c0c-5e6bb08af6b3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:56.493639 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-cf6a4e1e-5e29-4324-8c0c-5e6bb08af6b3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.254222 Jan 28 00:56:56.494149 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 368/712] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:56:56 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:56:56.509880 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3db35e4e-993a-4994-a1c7-ca6531f407ce tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:56.510500 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3db35e4e-993a-4994-a1c7-ca6531f407ce tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:56.511676 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-95601561-7fc5-4899-8274-2858c0a1895a tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:56.517295 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3db35e4e-993a-4994-a1c7-ca6531f407ce tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:56.517750 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3db35e4e-993a-4994-a1c7-ca6531f407ce tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:56.518540 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3db35e4e-993a-4994-a1c7-ca6531f407ce tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:56.518976 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3db35e4e-993a-4994-a1c7-ca6531f407ce tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:56.520523 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-95601561-7fc5-4899-8274-2858c0a1895a tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1754 microversion: 2.1 time: 0.255028 Jan 28 00:56:56.521125 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 345/713] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:56 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1754 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:56:56.667074 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3db35e4e-993a-4994-a1c7-ca6531f407ce tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:56.675301 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3db35e4e-993a-4994-a1c7-ca6531f407ce tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1655 microversion: 2.1 time: 0.169291 Jan 28 00:56:56.675970 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 369/714] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:56 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1655 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:56.695373 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0c6ff92a-588f-465c-b33c-52957965fc5f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:56:56.703379 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0c6ff92a-588f-465c-b33c-52957965fc5f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:56.703837 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0c6ff92a-588f-465c-b33c-52957965fc5f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:56.728204 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0c6ff92a-588f-465c-b33c-52957965fc5f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Going to try to start instance {{(pid=127863) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 28 00:56:56.781606 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0c6ff92a-588f-465c-b33c-52957965fc5f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action" status: 202 len: 0 microversion: 2.1 time: 0.090449 Jan 28 00:56:56.782228 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 346/715] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:56:56 2022] POST /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:56:56.790477 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-097a36bb-78d2-4c53-ab0a-6064ede89c4c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:56.791203 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-097a36bb-78d2-4c53-ab0a-6064ede89c4c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:56.797199 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-097a36bb-78d2-4c53-ab0a-6064ede89c4c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:56.797661 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-097a36bb-78d2-4c53-ab0a-6064ede89c4c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:56.798521 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-097a36bb-78d2-4c53-ab0a-6064ede89c4c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:56.798983 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-097a36bb-78d2-4c53-ab0a-6064ede89c4c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:56.943992 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-097a36bb-78d2-4c53-ab0a-6064ede89c4c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:56.957609 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-097a36bb-78d2-4c53-ab0a-6064ede89c4c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1664 microversion: 2.1 time: 0.169619 Jan 28 00:56:56.958437 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 370/716] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:56 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1664 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:57.515122 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-af7f13a7-83c8-4642-97c4-acffca116909 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:57.516017 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-af7f13a7-83c8-4642-97c4-acffca116909 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:57.524196 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-af7f13a7-83c8-4642-97c4-acffca116909 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:57.524661 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-af7f13a7-83c8-4642-97c4-acffca116909 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:57.525573 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-af7f13a7-83c8-4642-97c4-acffca116909 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:57.526025 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-af7f13a7-83c8-4642-97c4-acffca116909 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:57.542053 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9d6b9907-5ce4-49bd-89b1-6999075590ea tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:57.545358 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9d6b9907-5ce4-49bd-89b1-6999075590ea tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:57.556849 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d6b9907-5ce4-49bd-89b1-6999075590ea tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:57.557918 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d6b9907-5ce4-49bd-89b1-6999075590ea tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:57.559043 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d6b9907-5ce4-49bd-89b1-6999075590ea tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:57.560410 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d6b9907-5ce4-49bd-89b1-6999075590ea tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:57.959463 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-af7f13a7-83c8-4642-97c4-acffca116909 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:57.968263 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-af7f13a7-83c8-4642-97c4-acffca116909 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:57.969847 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-af7f13a7-83c8-4642-97c4-acffca116909 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:57.971129 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-af7f13a7-83c8-4642-97c4-acffca116909 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1723 microversion: 2.20 time: 0.462060 Jan 28 00:56:57.971735 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 347/717] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:56:57 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1723 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:56:57.976269 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-33e91907-340b-4252-bd56-b132204b4d59 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:57.976890 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-33e91907-340b-4252-bd56-b132204b4d59 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:57.984048 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-33e91907-340b-4252-bd56-b132204b4d59 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:57.984541 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-33e91907-340b-4252-bd56-b132204b4d59 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:57.985344 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-33e91907-340b-4252-bd56-b132204b4d59 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:57.985788 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-33e91907-340b-4252-bd56-b132204b4d59 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:58.003908 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9d6b9907-5ce4-49bd-89b1-6999075590ea tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:58.012421 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9d6b9907-5ce4-49bd-89b1-6999075590ea tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1754 microversion: 2.1 time: 0.478081 Jan 28 00:56:58.014077 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 371/718] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:57 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1754 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:58.209871 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-33e91907-340b-4252-bd56-b132204b4d59 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:58.218205 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-33e91907-340b-4252-bd56-b132204b4d59 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1664 microversion: 2.1 time: 0.245435 Jan 28 00:56:58.219078 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 348/719] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:57 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1664 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:58.578180 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-4c3e06ba-22cd-4c79-97de-74f848ed34b7 req-ece92e63-81c5-45b6-b72a-0971e19a95ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4", "name": "network-vif-deleted", "tag": "83fc2ec7-8030-466d-ac4d-dc369ac1f250"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:56:58.591671 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:56:58.591671 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:56:58.612107 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-4c3e06ba-22cd-4c79-97de-74f848ed34b7 req-ece92e63-81c5-45b6-b72a-0971e19a95ba service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:58.612715 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-4c3e06ba-22cd-4c79-97de-74f848ed34b7 req-ece92e63-81c5-45b6-b72a-0971e19a95ba service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:58.627517 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-4c3e06ba-22cd-4c79-97de-74f848ed34b7 req-ece92e63-81c5-45b6-b72a-0971e19a95ba service nova] Creating event network-vif-deleted:83fc2ec7-8030-466d-ac4d-dc369ac1f250 for instance 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 on hv-cinder-80952 Jan 28 00:56:58.636205 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-4c3e06ba-22cd-4c79-97de-74f848ed34b7 req-ece92e63-81c5-45b6-b72a-0971e19a95ba service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064281 Jan 28 00:56:58.637098 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 372/720] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:56:58.990250 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c48bc3b7-da64-4cea-935d-7c1b3b46133c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:58.990855 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c48bc3b7-da64-4cea-935d-7c1b3b46133c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:58.998312 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c48bc3b7-da64-4cea-935d-7c1b3b46133c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:58.998778 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c48bc3b7-da64-4cea-935d-7c1b3b46133c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:58.999800 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c48bc3b7-da64-4cea-935d-7c1b3b46133c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:59.000239 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c48bc3b7-da64-4cea-935d-7c1b3b46133c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:59.033411 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d5710a94-003b-4e9c-afee-0f2009a125b5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:59.034484 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d5710a94-003b-4e9c-afee-0f2009a125b5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:59.035347 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c48bc3b7-da64-4cea-935d-7c1b3b46133c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:59.035862 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c48bc3b7-da64-4cea-935d-7c1b3b46133c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:59.036319 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.objects.instance [None req-c48bc3b7-da64-4cea-935d-7c1b3b46133c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lazy-loading 'fault' on Instance uuid 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 {{(pid=127863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:56:59.045641 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d5710a94-003b-4e9c-afee-0f2009a125b5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:59.046472 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d5710a94-003b-4e9c-afee-0f2009a125b5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:59.047410 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d5710a94-003b-4e9c-afee-0f2009a125b5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:59.048262 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d5710a94-003b-4e9c-afee-0f2009a125b5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:59.090886 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-c48bc3b7-da64-4cea-935d-7c1b3b46133c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:59.111846 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-c48bc3b7-da64-4cea-935d-7c1b3b46133c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:59.111846 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-c48bc3b7-da64-4cea-935d-7c1b3b46133c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:59.112917 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c48bc3b7-da64-4cea-935d-7c1b3b46133c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 200 len: 1372 microversion: 2.20 time: 0.126284 Jan 28 00:56:59.113801 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 349/721] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:56:58 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 1372 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:56:59.237814 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1c81edf0-5920-4e61-88c0-4f25b760c7e7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:56:59.238893 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-1c81edf0-5920-4e61-88c0-4f25b760c7e7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:56:59.248306 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1c81edf0-5920-4e61-88c0-4f25b760c7e7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:59.248853 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1c81edf0-5920-4e61-88c0-4f25b760c7e7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:59.249731 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1c81edf0-5920-4e61-88c0-4f25b760c7e7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:56:59.250202 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1c81edf0-5920-4e61-88c0-4f25b760c7e7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:56:59.290133 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d5710a94-003b-4e9c-afee-0f2009a125b5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:59.298802 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d5710a94-003b-4e9c-afee-0f2009a125b5 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1754 microversion: 2.1 time: 0.271691 Jan 28 00:56:59.300033 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 373/722] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:59 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1754 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:56:59.410009 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-1c81edf0-5920-4e61-88c0-4f25b760c7e7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:56:59.417546 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1c81edf0-5920-4e61-88c0-4f25b760c7e7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1668 microversion: 2.1 time: 0.184616 Jan 28 00:56:59.418127 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 350/723] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:56:59 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1668 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:00.131907 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9d19cc76-4ec7-46cb-be59-4ef6bc92e42f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:00.132528 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9d19cc76-4ec7-46cb-be59-4ef6bc92e42f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:00.140074 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d19cc76-4ec7-46cb-be59-4ef6bc92e42f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:00.140541 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d19cc76-4ec7-46cb-be59-4ef6bc92e42f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:00.141427 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d19cc76-4ec7-46cb-be59-4ef6bc92e42f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:00.141872 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d19cc76-4ec7-46cb-be59-4ef6bc92e42f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:00.156788 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-9d19cc76-4ec7-46cb-be59-4ef6bc92e42f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] HTTP exception thrown: Instance 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 could not be found. Jan 28 00:57:00.157389 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9d19cc76-4ec7-46cb-be59-4ef6bc92e42f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Returning 404 to user: Instance 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:57:00.158671 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9d19cc76-4ec7-46cb-be59-4ef6bc92e42f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 404 len: 111 microversion: 2.20 time: 0.030283 Jan 28 00:57:00.159389 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 374/724] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:57:00 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 00:57:00.176412 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-82484ce9-8ca7-4793-a6a8-85b4a6bb6a7d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '.version_select at 0x7fbbc2252160>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:00.196677 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-82484ce9-8ca7-4793-a6a8-85b4a6bb6a7d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1847242233" status: 204 len: 0 microversion: 2.20 time: 0.029619 Jan 28 00:57:00.197256 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 351/725] 10.222.0.25 () {60 vars in 1261 bytes} [Fri Jan 28 00:57:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1847242233 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 00:57:00.317000 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-e77415ff-95ef-44bc-9d29-7b0485f83334 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:00.317802 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-e77415ff-95ef-44bc-9d29-7b0485f83334 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:00.324105 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e77415ff-95ef-44bc-9d29-7b0485f83334 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:00.324855 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e77415ff-95ef-44bc-9d29-7b0485f83334 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:00.325763 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e77415ff-95ef-44bc-9d29-7b0485f83334 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:00.326321 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e77415ff-95ef-44bc-9d29-7b0485f83334 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:00.506337 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-e77415ff-95ef-44bc-9d29-7b0485f83334 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:00.515107 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-e77415ff-95ef-44bc-9d29-7b0485f83334 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1754 microversion: 2.1 time: 0.201970 Jan 28 00:57:00.524544 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 375/726] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:00 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1754 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:00.982613 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-47dd6300-18c7-4b8c-8185-987e555b23c2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'create', calling method: .version_select at 0x7fbbc22e6d30>, body: {"keypair": {"name": "tempest-keypair-1173344140"}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:01.000828 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-47dd6300-18c7-4b8c-8185-987e555b23c2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Getting quotas for project 6db84ca9b72548269154e343a33767b4. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:57:01.004832 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-47dd6300-18c7-4b8c-8185-987e555b23c2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Getting quotas for user ec5dffa23e574a9e97867c93c033fcdc and project 6db84ca9b72548269154e343a33767b4. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:57:01.137762 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-47dd6300-18c7-4b8c-8185-987e555b23c2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Getting quotas for project 6db84ca9b72548269154e343a33767b4. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:57:01.143477 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-47dd6300-18c7-4b8c-8185-987e555b23c2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Getting quotas for user ec5dffa23e574a9e97867c93c033fcdc and project 6db84ca9b72548269154e343a33767b4. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:57:01.161556 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-47dd6300-18c7-4b8c-8185-987e555b23c2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.183201 Jan 28 00:57:01.162187 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 352/727] 10.222.0.25 () {62 vars in 1198 bytes} [Fri Jan 28 00:57:00 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 185 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 28 00:57:01.533222 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7815333b-a4de-42d1-9824-8b3a044548a9 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:01.533849 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7815333b-a4de-42d1-9824-8b3a044548a9 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:01.542591 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7815333b-a4de-42d1-9824-8b3a044548a9 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:01.542591 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7815333b-a4de-42d1-9824-8b3a044548a9 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:01.549243 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7815333b-a4de-42d1-9824-8b3a044548a9 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:01.550156 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7815333b-a4de-42d1-9824-8b3a044548a9 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:01.771936 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7815333b-a4de-42d1-9824-8b3a044548a9 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:01.785101 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7815333b-a4de-42d1-9824-8b3a044548a9 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1754 microversion: 2.1 time: 0.256311 Jan 28 00:57:01.785847 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 376/728] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:01 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1754 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:02.803228 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ddc1c533-1058-4daa-ba87-511410a4f14f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:02.803892 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ddc1c533-1058-4daa-ba87-511410a4f14f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:02.813584 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d461d1a1-dc8c-4ddc-bab6-574d1cd5cf95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-211257955", "imageRef": "7fe09c59-2ff9-4639-b39d-9a474e83ad91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60bc67ad-875c-4481-b3b6-be4a8a149f54"}], "security_groups": [{"name": "tempest-securitygroup--1977747133"}], "key_name": "tempest-keypair-1173344140", "user_data": "}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:02.817517 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ddc1c533-1058-4daa-ba87-511410a4f14f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:02.819754 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ddc1c533-1058-4daa-ba87-511410a4f14f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:02.820924 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ddc1c533-1058-4daa-ba87-511410a4f14f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:02.821471 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ddc1c533-1058-4daa-ba87-511410a4f14f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:02.996818 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.network.neutron [None req-d461d1a1-dc8c-4ddc-bab6-574d1cd5cf95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] validate_networks() for [('60bc67ad-875c-4481-b3b6-be4a8a149f54', None, None, None, None, None)] {{(pid=127862) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:57:03.121103 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-ddc1c533-1058-4daa-ba87-511410a4f14f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:03.130520 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ddc1c533-1058-4daa-ba87-511410a4f14f tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1754 microversion: 2.1 time: 0.330836 Jan 28 00:57:03.131461 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 353/729] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:02 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1754 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:03.944374 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-d461d1a1-dc8c-4ddc-bab6-574d1cd5cf95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Flavor limits 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:57:03.944981 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-d461d1a1-dc8c-4ddc-bab6-574d1cd5cf95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Image limits 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:57:03.945357 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-d461d1a1-dc8c-4ddc-bab6-574d1cd5cf95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Flavor pref 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:57:03.945813 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-d461d1a1-dc8c-4ddc-bab6-574d1cd5cf95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Image pref 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:57:03.946235 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-d461d1a1-dc8c-4ddc-bab6-574d1cd5cf95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:57:03.959065 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d461d1a1-dc8c-4ddc-bab6-574d1cd5cf95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:03.959563 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d461d1a1-dc8c-4ddc-bab6-574d1cd5cf95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:03.960404 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d461d1a1-dc8c-4ddc-bab6-574d1cd5cf95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:03.960857 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d461d1a1-dc8c-4ddc-bab6-574d1cd5cf95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:03.987941 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-d461d1a1-dc8c-4ddc-bab6-574d1cd5cf95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Getting quotas for project 6db84ca9b72548269154e343a33767b4. Resources: {'instances', 'cores', 'ram'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:57:03.992353 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-d461d1a1-dc8c-4ddc-bab6-574d1cd5cf95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Getting quotas for user ec5dffa23e574a9e97867c93c033fcdc and project 6db84ca9b72548269154e343a33767b4. Resources: {'instances', 'cores', 'ram'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:57:04.009287 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d461d1a1-dc8c-4ddc-bab6-574d1cd5cf95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Going to run 1 instances... {{(pid=127862) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:57:04.012628 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d461d1a1-dc8c-4ddc-bab6-574d1cd5cf95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fe09c59-2ff9-4639-b39d-9a474e83ad91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:57:04.068756 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d461d1a1-dc8c-4ddc-bab6-574d1cd5cf95 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.261702 Jan 28 00:57:04.074290 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 377/730] 10.222.0.25 () {62 vars in 1187 bytes} [Fri Jan 28 00:57:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1263 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jan 28 00:57:04.081507 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d5c307ad-d411-409c-9ff9-b1870e3474a9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:04.082290 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d5c307ad-d411-409c-9ff9-b1870e3474a9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:04.159972 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-c35ca1bc-c9f9-42f6-bf45-60bf9e3519d4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:04.161111 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-c35ca1bc-c9f9-42f6-bf45-60bf9e3519d4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:04.180386 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c35ca1bc-c9f9-42f6-bf45-60bf9e3519d4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:04.182708 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c35ca1bc-c9f9-42f6-bf45-60bf9e3519d4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:04.183819 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c35ca1bc-c9f9-42f6-bf45-60bf9e3519d4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:04.184280 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c35ca1bc-c9f9-42f6-bf45-60bf9e3519d4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:04.200196 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d5c307ad-d411-409c-9ff9-b1870e3474a9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:04.210509 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d5c307ad-d411-409c-9ff9-b1870e3474a9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:04.212453 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d5c307ad-d411-409c-9ff9-b1870e3474a9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:04.214303 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d5c307ad-d411-409c-9ff9-b1870e3474a9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1281 microversion: 2.20 time: 0.137108 Jan 28 00:57:04.216834 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 354/731] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:57:04 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1281 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:57:04.420612 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c35ca1bc-c9f9-42f6-bf45-60bf9e3519d4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:04.437127 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-c35ca1bc-c9f9-42f6-bf45-60bf9e3519d4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1754 microversion: 2.1 time: 0.291231 Jan 28 00:57:04.438129 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 378/732] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:04 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1754 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:05.233547 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d0c9d157-5d9c-4753-87bb-33c2d75df549 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:05.234366 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d0c9d157-5d9c-4753-87bb-33c2d75df549 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:05.244332 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d0c9d157-5d9c-4753-87bb-33c2d75df549 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:05.244791 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d0c9d157-5d9c-4753-87bb-33c2d75df549 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:05.245582 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d0c9d157-5d9c-4753-87bb-33c2d75df549 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:05.246023 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d0c9d157-5d9c-4753-87bb-33c2d75df549 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:05.312711 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d0c9d157-5d9c-4753-87bb-33c2d75df549 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:05.322631 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d0c9d157-5d9c-4753-87bb-33c2d75df549 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:05.324433 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d0c9d157-5d9c-4753-87bb-33c2d75df549 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:05.326336 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d0c9d157-5d9c-4753-87bb-33c2d75df549 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1333 microversion: 2.20 time: 0.095734 Jan 28 00:57:05.327106 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 355/733] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:57:05 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1333 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:57:05.465218 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-8a785067-2487-4858-9b8f-d35f271bece4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:05.466632 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-8a785067-2487-4858-9b8f-d35f271bece4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:05.474131 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8a785067-2487-4858-9b8f-d35f271bece4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:05.474922 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8a785067-2487-4858-9b8f-d35f271bece4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:05.476206 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8a785067-2487-4858-9b8f-d35f271bece4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:05.477284 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8a785067-2487-4858-9b8f-d35f271bece4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:05.728767 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-8a785067-2487-4858-9b8f-d35f271bece4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:05.748488 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-8a785067-2487-4858-9b8f-d35f271bece4 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1757 microversion: 2.1 time: 0.288099 Jan 28 00:57:05.749117 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 379/734] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:05 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1757 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:06.346021 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b3021616-b5e9-40f5-a81f-7101d42f9686 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:06.347582 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b3021616-b5e9-40f5-a81f-7101d42f9686 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:06.356096 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b3021616-b5e9-40f5-a81f-7101d42f9686 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:06.357501 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b3021616-b5e9-40f5-a81f-7101d42f9686 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:06.358737 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b3021616-b5e9-40f5-a81f-7101d42f9686 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:06.359180 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b3021616-b5e9-40f5-a81f-7101d42f9686 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:06.644482 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b3021616-b5e9-40f5-a81f-7101d42f9686 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:06.663059 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b3021616-b5e9-40f5-a81f-7101d42f9686 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:06.667484 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b3021616-b5e9-40f5-a81f-7101d42f9686 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:06.670723 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b3021616-b5e9-40f5-a81f-7101d42f9686 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1407 microversion: 2.20 time: 0.329908 Jan 28 00:57:06.672251 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 356/735] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:57:06 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:57:07.238584 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-315d43e5-9879-4068-a758-24928bbea2ea req-d14b4b74-8cb4-46cf-a3e9-3ef5e0fe355f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449f7a22-44b6-4b73-97ae-5e6103c1f90e", "tag": "3c8d8372-3e6d-4edb-96a4-9c2255946417"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:07.240883 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:57:07.240883 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:57:07.272821 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-315d43e5-9879-4068-a758-24928bbea2ea req-d14b4b74-8cb4-46cf-a3e9-3ef5e0fe355f service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:07.278265 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-315d43e5-9879-4068-a758-24928bbea2ea req-d14b4b74-8cb4-46cf-a3e9-3ef5e0fe355f service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:07.296248 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-315d43e5-9879-4068-a758-24928bbea2ea req-d14b4b74-8cb4-46cf-a3e9-3ef5e0fe355f service nova] Creating event network-changed:3c8d8372-3e6d-4edb-96a4-9c2255946417 for instance 449f7a22-44b6-4b73-97ae-5e6103c1f90e on hv-cinder-80952 Jan 28 00:57:07.302037 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-315d43e5-9879-4068-a758-24928bbea2ea req-d14b4b74-8cb4-46cf-a3e9-3ef5e0fe355f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067938 Jan 28 00:57:07.303264 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 380/736] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:07.693402 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4f88ed0c-ecf4-4165-8a31-0812a3ad6237 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:07.693952 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4f88ed0c-ecf4-4165-8a31-0812a3ad6237 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:07.701100 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f88ed0c-ecf4-4165-8a31-0812a3ad6237 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:07.702231 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f88ed0c-ecf4-4165-8a31-0812a3ad6237 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:07.703064 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f88ed0c-ecf4-4165-8a31-0812a3ad6237 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:07.703540 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f88ed0c-ecf4-4165-8a31-0812a3ad6237 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:07.844527 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4f88ed0c-ecf4-4165-8a31-0812a3ad6237 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:07.852756 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4f88ed0c-ecf4-4165-8a31-0812a3ad6237 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:07.854285 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4f88ed0c-ecf4-4165-8a31-0812a3ad6237 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:07.855466 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4f88ed0c-ecf4-4165-8a31-0812a3ad6237 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1407 microversion: 2.20 time: 0.165892 Jan 28 00:57:07.856046 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 357/737] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:57:07 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:57:08.876463 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7d777e25-933c-4199-8d03-507717542858 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:08.877222 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7d777e25-933c-4199-8d03-507717542858 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:08.884319 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7d777e25-933c-4199-8d03-507717542858 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:08.884781 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7d777e25-933c-4199-8d03-507717542858 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:08.885582 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7d777e25-933c-4199-8d03-507717542858 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:08.886050 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7d777e25-933c-4199-8d03-507717542858 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:09.031211 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7d777e25-933c-4199-8d03-507717542858 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:09.039714 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7d777e25-933c-4199-8d03-507717542858 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:09.041243 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7d777e25-933c-4199-8d03-507717542858 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:09.042377 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7d777e25-933c-4199-8d03-507717542858 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1407 microversion: 2.20 time: 0.171803 Jan 28 00:57:09.042950 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 381/738] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:57:08 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:57:10.065288 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-6d27c0d9-3685-4be6-9cfd-02a20bb11ca0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:10.066631 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-6d27c0d9-3685-4be6-9cfd-02a20bb11ca0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:10.074581 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6d27c0d9-3685-4be6-9cfd-02a20bb11ca0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:10.075413 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6d27c0d9-3685-4be6-9cfd-02a20bb11ca0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:10.076755 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6d27c0d9-3685-4be6-9cfd-02a20bb11ca0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:10.077286 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6d27c0d9-3685-4be6-9cfd-02a20bb11ca0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:10.260552 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-6d27c0d9-3685-4be6-9cfd-02a20bb11ca0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:10.272497 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-6d27c0d9-3685-4be6-9cfd-02a20bb11ca0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:10.275716 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-6d27c0d9-3685-4be6-9cfd-02a20bb11ca0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:10.277099 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-6d27c0d9-3685-4be6-9cfd-02a20bb11ca0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1407 microversion: 2.20 time: 0.220218 Jan 28 00:57:10.278274 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 358/739] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:57:10 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:57:11.300869 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f05a5a2e-7aa5-45f3-93f5-0b785d561c28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:11.301515 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f05a5a2e-7aa5-45f3-93f5-0b785d561c28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:11.307642 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f05a5a2e-7aa5-45f3-93f5-0b785d561c28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:11.308105 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f05a5a2e-7aa5-45f3-93f5-0b785d561c28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:11.308928 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f05a5a2e-7aa5-45f3-93f5-0b785d561c28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:11.309378 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f05a5a2e-7aa5-45f3-93f5-0b785d561c28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:11.486593 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f05a5a2e-7aa5-45f3-93f5-0b785d561c28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:11.495467 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f05a5a2e-7aa5-45f3-93f5-0b785d561c28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:11.497130 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f05a5a2e-7aa5-45f3-93f5-0b785d561c28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:11.499287 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f05a5a2e-7aa5-45f3-93f5-0b785d561c28 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1407 microversion: 2.20 time: 0.203582 Jan 28 00:57:11.499880 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 382/740] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:57:11 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:57:12.290491 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-8bec413e-b3a1-4411-a826-cdc3424f63bd req-d5f0934d-2e44-4ccf-be17-dd44793f859e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449f7a22-44b6-4b73-97ae-5e6103c1f90e", "name": "network-vif-plugged", "status": "completed", "tag": "3c8d8372-3e6d-4edb-96a4-9c2255946417"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:12.292342 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:57:12.292342 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:57:12.300378 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-8bec413e-b3a1-4411-a826-cdc3424f63bd req-d5f0934d-2e44-4ccf-be17-dd44793f859e service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:12.300920 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-8bec413e-b3a1-4411-a826-cdc3424f63bd req-d5f0934d-2e44-4ccf-be17-dd44793f859e service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:12.317091 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-8bec413e-b3a1-4411-a826-cdc3424f63bd req-d5f0934d-2e44-4ccf-be17-dd44793f859e service nova] Creating event network-vif-plugged:3c8d8372-3e6d-4edb-96a4-9c2255946417 for instance 449f7a22-44b6-4b73-97ae-5e6103c1f90e on hv-cinder-80952 Jan 28 00:57:12.323156 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-8bec413e-b3a1-4411-a826-cdc3424f63bd req-d5f0934d-2e44-4ccf-be17-dd44793f859e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036346 Jan 28 00:57:12.323805 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 359/741] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:57:12.518250 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ba72ddfb-6cdb-415c-976d-7f005f9161dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:12.519095 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ba72ddfb-6cdb-415c-976d-7f005f9161dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:12.525379 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ba72ddfb-6cdb-415c-976d-7f005f9161dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:12.525840 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ba72ddfb-6cdb-415c-976d-7f005f9161dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:12.526650 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ba72ddfb-6cdb-415c-976d-7f005f9161dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:12.527095 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ba72ddfb-6cdb-415c-976d-7f005f9161dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:12.738612 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ba72ddfb-6cdb-415c-976d-7f005f9161dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:12.747943 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ba72ddfb-6cdb-415c-976d-7f005f9161dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:12.749625 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ba72ddfb-6cdb-415c-976d-7f005f9161dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:12.750796 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ba72ddfb-6cdb-415c-976d-7f005f9161dc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1407 microversion: 2.20 time: 0.236658 Jan 28 00:57:12.751358 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 383/742] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:57:12 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:57:13.770755 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-78945db5-9b82-4fa1-9666-4fcb4e40c04c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:13.771579 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-78945db5-9b82-4fa1-9666-4fcb4e40c04c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:13.778490 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-78945db5-9b82-4fa1-9666-4fcb4e40c04c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:13.779048 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-78945db5-9b82-4fa1-9666-4fcb4e40c04c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:13.780097 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-78945db5-9b82-4fa1-9666-4fcb4e40c04c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:13.780608 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-78945db5-9b82-4fa1-9666-4fcb4e40c04c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:13.946869 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-78945db5-9b82-4fa1-9666-4fcb4e40c04c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:13.956194 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-78945db5-9b82-4fa1-9666-4fcb4e40c04c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:13.958166 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-78945db5-9b82-4fa1-9666-4fcb4e40c04c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:13.959900 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-78945db5-9b82-4fa1-9666-4fcb4e40c04c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1407 microversion: 2.20 time: 0.193530 Jan 28 00:57:13.960240 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 360/743] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:57:13 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:57:14.979767 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-c7bbc2c6-c5fb-4e30-85ea-6e0801f6ace3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:14.980491 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-c7bbc2c6-c5fb-4e30-85ea-6e0801f6ace3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:14.987385 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c7bbc2c6-c5fb-4e30-85ea-6e0801f6ace3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:14.987854 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c7bbc2c6-c5fb-4e30-85ea-6e0801f6ace3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:14.988698 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c7bbc2c6-c5fb-4e30-85ea-6e0801f6ace3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:14.989454 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c7bbc2c6-c5fb-4e30-85ea-6e0801f6ace3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:15.150762 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c7bbc2c6-c5fb-4e30-85ea-6e0801f6ace3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:15.159521 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c7bbc2c6-c5fb-4e30-85ea-6e0801f6ace3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:15.161072 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c7bbc2c6-c5fb-4e30-85ea-6e0801f6ace3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:15.162305 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-c7bbc2c6-c5fb-4e30-85ea-6e0801f6ace3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1599 microversion: 2.20 time: 0.188137 Jan 28 00:57:15.162890 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 384/744] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:57:14 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1599 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:57:15.184076 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-aeb8d6bd-a6ac-4b0f-8e5f-2663a5c70678 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:15.185791 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-aeb8d6bd-a6ac-4b0f-8e5f-2663a5c70678 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:15.193184 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-aeb8d6bd-a6ac-4b0f-8e5f-2663a5c70678 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:15.193633 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-aeb8d6bd-a6ac-4b0f-8e5f-2663a5c70678 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:15.194438 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-aeb8d6bd-a6ac-4b0f-8e5f-2663a5c70678 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:15.196389 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-aeb8d6bd-a6ac-4b0f-8e5f-2663a5c70678 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:15.293014 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-aeb8d6bd-a6ac-4b0f-8e5f-2663a5c70678 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.115352 Jan 28 00:57:15.293942 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 361/745] 10.222.0.25 () {60 vars in 1315 bytes} [Fri Jan 28 00:57:15 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:57:16.425937 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-8bde8d70-d654-48ac-ac0a-04943308ebc2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:16.426868 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-8bde8d70-d654-48ac-ac0a-04943308ebc2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:16.434125 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8bde8d70-d654-48ac-ac0a-04943308ebc2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:16.435408 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8bde8d70-d654-48ac-ac0a-04943308ebc2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:16.436597 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8bde8d70-d654-48ac-ac0a-04943308ebc2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:16.437281 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8bde8d70-d654-48ac-ac0a-04943308ebc2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:16.572490 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-8bde8d70-d654-48ac-ac0a-04943308ebc2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 14 microversion: 2.20 time: 0.149605 Jan 28 00:57:16.575963 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 385/746] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:16 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:16.579057 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-e8b3e360-2972-45d9-99d6-10c5fef65122 req-5927fb82-5fcd-4fba-b96f-dc36dab4ec7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449f7a22-44b6-4b73-97ae-5e6103c1f90e", "tag": "3c8d8372-3e6d-4edb-96a4-9c2255946417"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:16.581184 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:57:16.581184 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:57:16.588712 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-e8b3e360-2972-45d9-99d6-10c5fef65122 req-5927fb82-5fcd-4fba-b96f-dc36dab4ec7d service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:16.589253 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-e8b3e360-2972-45d9-99d6-10c5fef65122 req-5927fb82-5fcd-4fba-b96f-dc36dab4ec7d service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:16.603834 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-e8b3e360-2972-45d9-99d6-10c5fef65122 req-5927fb82-5fcd-4fba-b96f-dc36dab4ec7d service nova] Creating event network-changed:3c8d8372-3e6d-4edb-96a4-9c2255946417 for instance 449f7a22-44b6-4b73-97ae-5e6103c1f90e on hv-cinder-80952 Jan 28 00:57:16.609688 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-e8b3e360-2972-45d9-99d6-10c5fef65122 req-5927fb82-5fcd-4fba-b96f-dc36dab4ec7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184518 Jan 28 00:57:16.610862 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 362/747] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:17.585263 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-28ee6bd2-3e42-4cb4-8c8c-9995d58a8970 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:17.586302 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-28ee6bd2-3e42-4cb4-8c8c-9995d58a8970 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:17.595105 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-28ee6bd2-3e42-4cb4-8c8c-9995d58a8970 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:17.595981 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-28ee6bd2-3e42-4cb4-8c8c-9995d58a8970 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:17.596525 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-28ee6bd2-3e42-4cb4-8c8c-9995d58a8970 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:17.596872 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-28ee6bd2-3e42-4cb4-8c8c-9995d58a8970 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:17.702506 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-28ee6bd2-3e42-4cb4-8c8c-9995d58a8970 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 14 microversion: 2.20 time: 0.120939 Jan 28 00:57:17.703185 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 386/748] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:17 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:18.721516 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-36217faf-e741-46bc-afa7-ef4ec4ac0b49 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:18.723058 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-36217faf-e741-46bc-afa7-ef4ec4ac0b49 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:18.734836 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-36217faf-e741-46bc-afa7-ef4ec4ac0b49 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:18.735409 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-36217faf-e741-46bc-afa7-ef4ec4ac0b49 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:18.736338 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-36217faf-e741-46bc-afa7-ef4ec4ac0b49 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:18.736828 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-36217faf-e741-46bc-afa7-ef4ec4ac0b49 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:18.874485 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-36217faf-e741-46bc-afa7-ef4ec4ac0b49 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 14 microversion: 2.20 time: 0.162615 Jan 28 00:57:18.875498 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 363/749] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:18 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:19.887665 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-e3758dcb-1178-48aa-a6bb-768901a797bd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:19.889346 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-e3758dcb-1178-48aa-a6bb-768901a797bd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:19.897772 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e3758dcb-1178-48aa-a6bb-768901a797bd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:19.898357 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e3758dcb-1178-48aa-a6bb-768901a797bd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:19.899226 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e3758dcb-1178-48aa-a6bb-768901a797bd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:19.899793 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e3758dcb-1178-48aa-a6bb-768901a797bd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:20.007387 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-e3758dcb-1178-48aa-a6bb-768901a797bd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 14 microversion: 2.20 time: 0.123818 Jan 28 00:57:20.008425 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 387/750] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:19 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:21.021794 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1a363171-fffa-4452-ab04-6fe8b2260a00 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:21.023660 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-1a363171-fffa-4452-ab04-6fe8b2260a00 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:21.032970 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1a363171-fffa-4452-ab04-6fe8b2260a00 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:21.033340 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1a363171-fffa-4452-ab04-6fe8b2260a00 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:21.034139 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1a363171-fffa-4452-ab04-6fe8b2260a00 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:21.034579 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1a363171-fffa-4452-ab04-6fe8b2260a00 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:21.143062 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1a363171-fffa-4452-ab04-6fe8b2260a00 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 14 microversion: 2.20 time: 0.125828 Jan 28 00:57:21.144470 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 364/751] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:21 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:22.158542 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-918daf89-ef96-4a4d-bf24-2d30980304f2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:22.160173 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-918daf89-ef96-4a4d-bf24-2d30980304f2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:22.167067 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-918daf89-ef96-4a4d-bf24-2d30980304f2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:22.167630 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-918daf89-ef96-4a4d-bf24-2d30980304f2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:22.168396 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-918daf89-ef96-4a4d-bf24-2d30980304f2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:22.168838 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-918daf89-ef96-4a4d-bf24-2d30980304f2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:22.308033 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-918daf89-ef96-4a4d-bf24-2d30980304f2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 14 microversion: 2.20 time: 0.154716 Jan 28 00:57:22.309365 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 388/752] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:22 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:23.321291 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-269453de-17c9-46a1-956e-b8fee6ba58b3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:23.322316 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-269453de-17c9-46a1-956e-b8fee6ba58b3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:23.330188 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-269453de-17c9-46a1-956e-b8fee6ba58b3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:23.330620 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-269453de-17c9-46a1-956e-b8fee6ba58b3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:23.331462 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-269453de-17c9-46a1-956e-b8fee6ba58b3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:23.331911 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-269453de-17c9-46a1-956e-b8fee6ba58b3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:23.459007 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-269453de-17c9-46a1-956e-b8fee6ba58b3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 14 microversion: 2.20 time: 0.141799 Jan 28 00:57:23.459716 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 365/753] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:23 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:24.473384 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f868b65c-e6cc-46f0-a83e-d46d3022e057 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:24.474616 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f868b65c-e6cc-46f0-a83e-d46d3022e057 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:24.483148 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f868b65c-e6cc-46f0-a83e-d46d3022e057 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:24.483633 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f868b65c-e6cc-46f0-a83e-d46d3022e057 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:24.484446 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f868b65c-e6cc-46f0-a83e-d46d3022e057 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:24.484890 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f868b65c-e6cc-46f0-a83e-d46d3022e057 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:24.588444 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f868b65c-e6cc-46f0-a83e-d46d3022e057 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 14 microversion: 2.20 time: 0.118408 Jan 28 00:57:24.589457 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 389/754] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:24 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:25.604794 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-392561e2-3b18-4f51-aa9e-c4d95bb6db48 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:25.606113 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-392561e2-3b18-4f51-aa9e-c4d95bb6db48 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:25.619442 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-392561e2-3b18-4f51-aa9e-c4d95bb6db48 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:25.620233 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-392561e2-3b18-4f51-aa9e-c4d95bb6db48 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:25.621597 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-392561e2-3b18-4f51-aa9e-c4d95bb6db48 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:25.622810 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-392561e2-3b18-4f51-aa9e-c4d95bb6db48 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:25.751778 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-392561e2-3b18-4f51-aa9e-c4d95bb6db48 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 14 microversion: 2.20 time: 0.151010 Jan 28 00:57:25.751778 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 366/755] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:25 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:26.765100 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-24455d18-cd70-4a10-a9e6-5b0a9f78b2c6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:26.766933 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-24455d18-cd70-4a10-a9e6-5b0a9f78b2c6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:26.776160 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-24455d18-cd70-4a10-a9e6-5b0a9f78b2c6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:26.776569 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-24455d18-cd70-4a10-a9e6-5b0a9f78b2c6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:26.777556 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-24455d18-cd70-4a10-a9e6-5b0a9f78b2c6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:26.778002 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-24455d18-cd70-4a10-a9e6-5b0a9f78b2c6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:26.898765 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-24455d18-cd70-4a10-a9e6-5b0a9f78b2c6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 14 microversion: 2.20 time: 0.138911 Jan 28 00:57:26.899638 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 390/756] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:26 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:27.405072 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4a677dc3-4743-4e50-ad19-6dc7cf58be83 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:27.406053 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4a677dc3-4743-4e50-ad19-6dc7cf58be83 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:27.418242 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4a677dc3-4743-4e50-ad19-6dc7cf58be83 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:27.418984 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4a677dc3-4743-4e50-ad19-6dc7cf58be83 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:27.420656 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4a677dc3-4743-4e50-ad19-6dc7cf58be83 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:27.421272 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4a677dc3-4743-4e50-ad19-6dc7cf58be83 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:27.454154 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4a677dc3-4743-4e50-ad19-6dc7cf58be83 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Going to try to terminate instance {{(pid=127863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 00:57:27.564360 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4a677dc3-4743-4e50-ad19-6dc7cf58be83 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 204 len: 0 microversion: 2.1 time: 0.168103 Jan 28 00:57:27.567316 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 367/757] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 00:57:27 2022] DELETE /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 00:57:27.585381 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-542e51a6-9a15-4f83-b785-fec1fdd5354b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:27.586813 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-542e51a6-9a15-4f83-b785-fec1fdd5354b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:27.608405 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-542e51a6-9a15-4f83-b785-fec1fdd5354b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:27.609131 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-542e51a6-9a15-4f83-b785-fec1fdd5354b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:27.610258 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-542e51a6-9a15-4f83-b785-fec1fdd5354b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:27.610963 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-542e51a6-9a15-4f83-b785-fec1fdd5354b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:27.834849 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-542e51a6-9a15-4f83-b785-fec1fdd5354b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:27.846838 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-542e51a6-9a15-4f83-b785-fec1fdd5354b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1577 microversion: 2.1 time: 0.273351 Jan 28 00:57:27.848184 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 391/758] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:27 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1577 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:27.915450 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-21769120-329b-4954-ba6d-c6f8bde494e7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:27.916560 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-21769120-329b-4954-ba6d-c6f8bde494e7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:27.925200 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-21769120-329b-4954-ba6d-c6f8bde494e7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:27.928994 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-21769120-329b-4954-ba6d-c6f8bde494e7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:27.928994 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-21769120-329b-4954-ba6d-c6f8bde494e7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:27.928994 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-21769120-329b-4954-ba6d-c6f8bde494e7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:28.049018 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-21769120-329b-4954-ba6d-c6f8bde494e7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 14 microversion: 2.20 time: 0.138125 Jan 28 00:57:28.050078 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 368/759] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:27 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:28.871654 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-54bf218e-d74d-40c1-b8a1-d1dd68a62cf5 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:28.872387 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-54bf218e-d74d-40c1-b8a1-d1dd68a62cf5 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:28.882722 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-54bf218e-d74d-40c1-b8a1-d1dd68a62cf5 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:28.883485 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-54bf218e-d74d-40c1-b8a1-d1dd68a62cf5 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:28.884659 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-54bf218e-d74d-40c1-b8a1-d1dd68a62cf5 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:28.885106 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-54bf218e-d74d-40c1-b8a1-d1dd68a62cf5 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:29.046595 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-54bf218e-d74d-40c1-b8a1-d1dd68a62cf5 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:29.055063 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-54bf218e-d74d-40c1-b8a1-d1dd68a62cf5 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1577 microversion: 2.1 time: 0.187511 Jan 28 00:57:29.055718 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 392/760] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:28 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:29.062095 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0d661f79-16e2-466a-8f84-b37ac87dd0d0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:29.063131 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0d661f79-16e2-466a-8f84-b37ac87dd0d0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:29.071257 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0d661f79-16e2-466a-8f84-b37ac87dd0d0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:29.071758 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0d661f79-16e2-466a-8f84-b37ac87dd0d0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:29.072699 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0d661f79-16e2-466a-8f84-b37ac87dd0d0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:29.073184 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0d661f79-16e2-466a-8f84-b37ac87dd0d0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:29.232643 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0d661f79-16e2-466a-8f84-b37ac87dd0d0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 14 microversion: 2.20 time: 0.174580 Jan 28 00:57:29.233218 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 369/761] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:29 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:30.083075 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-25317d87-874f-48d5-9c0c-7997fbd2b8a8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:30.083748 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-25317d87-874f-48d5-9c0c-7997fbd2b8a8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:30.091505 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-25317d87-874f-48d5-9c0c-7997fbd2b8a8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:30.092133 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-25317d87-874f-48d5-9c0c-7997fbd2b8a8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:30.093169 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-25317d87-874f-48d5-9c0c-7997fbd2b8a8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:30.093617 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-25317d87-874f-48d5-9c0c-7997fbd2b8a8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:30.249978 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f3e098c5-2370-40bc-936c-cbac3e79d340 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:30.251129 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f3e098c5-2370-40bc-936c-cbac3e79d340 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:30.262871 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f3e098c5-2370-40bc-936c-cbac3e79d340 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:30.264462 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f3e098c5-2370-40bc-936c-cbac3e79d340 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:30.265846 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f3e098c5-2370-40bc-936c-cbac3e79d340 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:30.266632 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f3e098c5-2370-40bc-936c-cbac3e79d340 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:30.279098 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-25317d87-874f-48d5-9c0c-7997fbd2b8a8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:30.290678 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-25317d87-874f-48d5-9c0c-7997fbd2b8a8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1577 microversion: 2.1 time: 0.211431 Jan 28 00:57:30.291868 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 393/762] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:30 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1577 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:30.421477 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f3e098c5-2370-40bc-936c-cbac3e79d340 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 14 microversion: 2.20 time: 0.177745 Jan 28 00:57:30.422288 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 370/763] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:30 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:31.311754 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-285ee044-4ad3-4617-9fba-b2d2d0a34974 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:31.312608 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-285ee044-4ad3-4617-9fba-b2d2d0a34974 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:31.321891 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-285ee044-4ad3-4617-9fba-b2d2d0a34974 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:31.322353 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-285ee044-4ad3-4617-9fba-b2d2d0a34974 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:31.323198 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-285ee044-4ad3-4617-9fba-b2d2d0a34974 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:31.323683 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-285ee044-4ad3-4617-9fba-b2d2d0a34974 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:31.424084 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-285ee044-4ad3-4617-9fba-b2d2d0a34974 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:31.435522 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ab41d0b7-ab63-4389-8b51-24a163a68398 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:31.436531 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-285ee044-4ad3-4617-9fba-b2d2d0a34974 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1510 microversion: 2.1 time: 0.129159 Jan 28 00:57:31.437364 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 394/764] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:31 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1510 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:31.440314 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ab41d0b7-ab63-4389-8b51-24a163a68398 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:31.448894 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ab41d0b7-ab63-4389-8b51-24a163a68398 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:31.449449 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ab41d0b7-ab63-4389-8b51-24a163a68398 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:31.453060 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ab41d0b7-ab63-4389-8b51-24a163a68398 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:31.453060 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ab41d0b7-ab63-4389-8b51-24a163a68398 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:31.595616 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ab41d0b7-ab63-4389-8b51-24a163a68398 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 7546 microversion: 2.20 time: 0.164705 Jan 28 00:57:31.597821 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 371/765] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:31 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 7546 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:57:31.617448 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-e7c42cdf-25de-4c02-ac4f-a62270d1557f req-bab1d6bc-195d-410a-85df-1e3fc33f74c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5a37e9-9762-4d3f-9756-97f267719f8c", "name": "network-vif-deleted", "tag": "ddcf3686-7e23-4e79-8ec0-b709d910fa59"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:31.620170 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:57:31.620170 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:57:31.631976 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-e7c42cdf-25de-4c02-ac4f-a62270d1557f req-bab1d6bc-195d-410a-85df-1e3fc33f74c0 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:31.632599 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-e7c42cdf-25de-4c02-ac4f-a62270d1557f req-bab1d6bc-195d-410a-85df-1e3fc33f74c0 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:31.659975 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-e7c42cdf-25de-4c02-ac4f-a62270d1557f req-bab1d6bc-195d-410a-85df-1e3fc33f74c0 service nova] Creating event network-vif-deleted:ddcf3686-7e23-4e79-8ec0-b709d910fa59 for instance ad5a37e9-9762-4d3f-9756-97f267719f8c on hv-cinder-80952 Jan 28 00:57:31.669641 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-e7c42cdf-25de-4c02-ac4f-a62270d1557f req-bab1d6bc-195d-410a-85df-1e3fc33f74c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056390 Jan 28 00:57:31.671922 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 395/766] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:32.461375 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-179de8cf-5172-4aa1-b8d2-8d321a35ad3b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:32.462419 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-179de8cf-5172-4aa1-b8d2-8d321a35ad3b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:32.473374 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-179de8cf-5172-4aa1-b8d2-8d321a35ad3b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:32.473917 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-179de8cf-5172-4aa1-b8d2-8d321a35ad3b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:32.475043 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-179de8cf-5172-4aa1-b8d2-8d321a35ad3b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:32.475604 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-179de8cf-5172-4aa1-b8d2-8d321a35ad3b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:32.515020 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-179de8cf-5172-4aa1-b8d2-8d321a35ad3b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:32.515770 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-179de8cf-5172-4aa1-b8d2-8d321a35ad3b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:32.516357 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.objects.instance [None req-179de8cf-5172-4aa1-b8d2-8d321a35ad3b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lazy-loading 'fault' on Instance uuid ad5a37e9-9762-4d3f-9756-97f267719f8c {{(pid=127863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:57:32.578788 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-179de8cf-5172-4aa1-b8d2-8d321a35ad3b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:32.588720 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-179de8cf-5172-4aa1-b8d2-8d321a35ad3b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 200 len: 1231 microversion: 2.1 time: 0.132139 Jan 28 00:57:32.589312 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 372/767] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:32 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 1231 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:32.614894 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-bc1d4a41-37e3-4964-a1cd-ad60659fdf94 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:32.617006 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-bc1d4a41-37e3-4964-a1cd-ad60659fdf94 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:32.626585 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bc1d4a41-37e3-4964-a1cd-ad60659fdf94 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:32.627186 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bc1d4a41-37e3-4964-a1cd-ad60659fdf94 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:32.628081 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bc1d4a41-37e3-4964-a1cd-ad60659fdf94 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:32.628531 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bc1d4a41-37e3-4964-a1cd-ad60659fdf94 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:32.783649 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-bc1d4a41-37e3-4964-a1cd-ad60659fdf94 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 11930 microversion: 2.20 time: 0.176430 Jan 28 00:57:32.786096 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 396/768] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:32 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 11930 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:57:33.610302 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-229a043e-bdbc-4d5f-8a48-eb9ea322406d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:33.611129 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-229a043e-bdbc-4d5f-8a48-eb9ea322406d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:33.621123 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-229a043e-bdbc-4d5f-8a48-eb9ea322406d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:33.621653 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-229a043e-bdbc-4d5f-8a48-eb9ea322406d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:33.623228 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-229a043e-bdbc-4d5f-8a48-eb9ea322406d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:33.623795 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-229a043e-bdbc-4d5f-8a48-eb9ea322406d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:33.639488 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-229a043e-bdbc-4d5f-8a48-eb9ea322406d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] HTTP exception thrown: Instance ad5a37e9-9762-4d3f-9756-97f267719f8c could not be found. Jan 28 00:57:33.640120 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-229a043e-bdbc-4d5f-8a48-eb9ea322406d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Returning 404 to user: Instance ad5a37e9-9762-4d3f-9756-97f267719f8c could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:57:33.640996 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-229a043e-bdbc-4d5f-8a48-eb9ea322406d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 404 len: 111 microversion: 2.1 time: 0.035102 Jan 28 00:57:33.641543 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 373/769] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:33 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:57:33.762685 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-51a18a2e-80c2-4498-baf7-b47b6f4a03b0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-770659716", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2038861869", "security_groups": [{"name": "tempest-secgroup-smoke-726777567"}], "block_device_mapping_v2": [{"uuid": "2bea1953-5792-42c0-8f47-2163687f562f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "30aa1d90-fbc0-4d47-a9cd-dbadcfadc4e7"}]}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:33.800496 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-bb9cff91-3fb2-4c4a-bb9d-c683b7d7bc25 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:33.802165 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-bb9cff91-3fb2-4c4a-bb9d-c683b7d7bc25 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:33.812232 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bb9cff91-3fb2-4c4a-bb9d-c683b7d7bc25 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:33.812783 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bb9cff91-3fb2-4c4a-bb9d-c683b7d7bc25 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:33.813650 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bb9cff91-3fb2-4c4a-bb9d-c683b7d7bc25 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:33.814231 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bb9cff91-3fb2-4c4a-bb9d-c683b7d7bc25 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:33.917361 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.network.neutron [None req-51a18a2e-80c2-4498-baf7-b47b6f4a03b0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] validate_networks() for [('30aa1d90-fbc0-4d47-a9cd-dbadcfadc4e7', None, None, None, None, None)] {{(pid=127862) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:57:33.953685 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-bb9cff91-3fb2-4c4a-bb9d-c683b7d7bc25 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 17354 microversion: 2.20 time: 0.159725 Jan 28 00:57:33.958326 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 374/770] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:33 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 17354 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:57:34.367343 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-51a18a2e-80c2-4498-baf7-b47b6f4a03b0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Flavor limits 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:57:34.367780 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-51a18a2e-80c2-4498-baf7-b47b6f4a03b0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Image limits 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:57:34.368450 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-51a18a2e-80c2-4498-baf7-b47b6f4a03b0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Flavor pref 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:57:34.369003 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-51a18a2e-80c2-4498-baf7-b47b6f4a03b0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Image pref 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:57:34.369584 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-51a18a2e-80c2-4498-baf7-b47b6f4a03b0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:57:34.383591 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-51a18a2e-80c2-4498-baf7-b47b6f4a03b0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:34.384278 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-51a18a2e-80c2-4498-baf7-b47b6f4a03b0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:34.385229 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-51a18a2e-80c2-4498-baf7-b47b6f4a03b0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:34.385781 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-51a18a2e-80c2-4498-baf7-b47b6f4a03b0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:34.406547 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-51a18a2e-80c2-4498-baf7-b47b6f4a03b0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Getting quotas for project dfca2fc1b6c24ac7910c44e6d7936366. Resources: {'instances', 'cores', 'ram'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:57:34.413650 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-51a18a2e-80c2-4498-baf7-b47b6f4a03b0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Getting quotas for user 4a973914214249bebd8bd067a8c21ac3 and project dfca2fc1b6c24ac7910c44e6d7936366. Resources: {'instances', 'cores', 'ram'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:57:34.480179 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-51a18a2e-80c2-4498-baf7-b47b6f4a03b0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Going to run 1 instances... {{(pid=127862) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:57:34.483346 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-51a18a2e-80c2-4498-baf7-b47b6f4a03b0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2bea1953-5792-42c0-8f47-2163687f562f',volume_size=None,volume_type=None)] {{(pid=127862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:57:34.657151 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-51a18a2e-80c2-4498-baf7-b47b6f4a03b0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.898972 Jan 28 00:57:34.658842 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 397/771] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 00:57:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 00:57:34.671261 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-227baf36-eaeb-47cb-84de-ecd6830e1ebf tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:34.672000 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-227baf36-eaeb-47cb-84de-ecd6830e1ebf tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:34.755916 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-227baf36-eaeb-47cb-84de-ecd6830e1ebf tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:34.763632 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-227baf36-eaeb-47cb-84de-ecd6830e1ebf tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1094 microversion: 2.1 time: 0.096998 Jan 28 00:57:34.764872 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 375/772] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:34 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1094 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:34.969270 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4c30f3de-58cc-4f7d-a9b8-43dd39691d5a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:34.970708 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4c30f3de-58cc-4f7d-a9b8-43dd39691d5a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:34.979045 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c30f3de-58cc-4f7d-a9b8-43dd39691d5a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:34.979547 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c30f3de-58cc-4f7d-a9b8-43dd39691d5a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:34.980492 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c30f3de-58cc-4f7d-a9b8-43dd39691d5a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:34.980933 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c30f3de-58cc-4f7d-a9b8-43dd39691d5a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:35.128693 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4c30f3de-58cc-4f7d-a9b8-43dd39691d5a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 17984 microversion: 2.20 time: 0.165528 Jan 28 00:57:35.134298 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 398/773] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:34 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 17984 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:57:35.782380 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e77b76a1-3c36-4c42-9891-1ca3323f67ad tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:35.783171 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e77b76a1-3c36-4c42-9891-1ca3323f67ad tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:35.790798 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e77b76a1-3c36-4c42-9891-1ca3323f67ad tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:35.791407 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e77b76a1-3c36-4c42-9891-1ca3323f67ad tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:35.792212 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e77b76a1-3c36-4c42-9891-1ca3323f67ad tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:35.792765 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e77b76a1-3c36-4c42-9891-1ca3323f67ad tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:35.874632 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e77b76a1-3c36-4c42-9891-1ca3323f67ad tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:35.891112 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e77b76a1-3c36-4c42-9891-1ca3323f67ad tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1192 microversion: 2.1 time: 0.114093 Jan 28 00:57:35.891773 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 376/774] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:35 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1192 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:36.149931 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-64d2ce8a-485e-409a-ae8a-f073a3d68718 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:36.160192 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-64d2ce8a-485e-409a-ae8a-f073a3d68718 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:36.176625 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-64d2ce8a-485e-409a-ae8a-f073a3d68718 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:36.177387 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-64d2ce8a-485e-409a-ae8a-f073a3d68718 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:36.179090 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-64d2ce8a-485e-409a-ae8a-f073a3d68718 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:36.180137 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-64d2ce8a-485e-409a-ae8a-f073a3d68718 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:36.388776 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-64d2ce8a-485e-409a-ae8a-f073a3d68718 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 19342 microversion: 2.20 time: 0.247086 Jan 28 00:57:36.390494 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 399/775] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:36 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 19342 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:57:36.912177 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-fea3cd06-74e8-460c-a2de-0c54eb637192 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:36.912778 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-fea3cd06-74e8-460c-a2de-0c54eb637192 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:36.920972 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fea3cd06-74e8-460c-a2de-0c54eb637192 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:36.921437 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fea3cd06-74e8-460c-a2de-0c54eb637192 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:36.922343 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fea3cd06-74e8-460c-a2de-0c54eb637192 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:36.922809 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fea3cd06-74e8-460c-a2de-0c54eb637192 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:37.013859 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-fea3cd06-74e8-460c-a2de-0c54eb637192 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:37.022212 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-fea3cd06-74e8-460c-a2de-0c54eb637192 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1210 microversion: 2.1 time: 0.115227 Jan 28 00:57:37.022914 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 377/776] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:36 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1210 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:37.412961 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-067f66f7-7eba-4b19-ba5a-ab1705065a3a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:37.417787 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-067f66f7-7eba-4b19-ba5a-ab1705065a3a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:37.433735 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-067f66f7-7eba-4b19-ba5a-ab1705065a3a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:37.434515 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-067f66f7-7eba-4b19-ba5a-ab1705065a3a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:37.437064 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-067f66f7-7eba-4b19-ba5a-ab1705065a3a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:37.437861 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-067f66f7-7eba-4b19-ba5a-ab1705065a3a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:37.586279 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-067f66f7-7eba-4b19-ba5a-ab1705065a3a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 21332 microversion: 2.20 time: 0.183858 Jan 28 00:57:37.589806 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 400/777] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:37 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 21332 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:57:38.060317 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d6c57b47-f627-496d-9559-0acb81d766f2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:38.060931 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d6c57b47-f627-496d-9559-0acb81d766f2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:38.074410 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d6c57b47-f627-496d-9559-0acb81d766f2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:38.077052 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d6c57b47-f627-496d-9559-0acb81d766f2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:38.078417 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d6c57b47-f627-496d-9559-0acb81d766f2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:38.079585 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d6c57b47-f627-496d-9559-0acb81d766f2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:38.118891 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-d97f0cd4-b405-4b45-bb6b-ba3fd08f2be7 req-3c432abd-aa36-4648-9a90-b53744a295bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b60be9-fc62-44f1-92b5-39e259500d4e", "tag": "0e8e3177-3ed6-4af8-a70f-1fe9fdeae77c"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:38.120903 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:57:38.120903 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:57:38.137935 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-d97f0cd4-b405-4b45-bb6b-ba3fd08f2be7 req-3c432abd-aa36-4648-9a90-b53744a295bb service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:38.155767 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-d97f0cd4-b405-4b45-bb6b-ba3fd08f2be7 req-3c432abd-aa36-4648-9a90-b53744a295bb service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:38.172044 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-d97f0cd4-b405-4b45-bb6b-ba3fd08f2be7 req-3c432abd-aa36-4648-9a90-b53744a295bb service nova] Creating event network-changed:0e8e3177-3ed6-4af8-a70f-1fe9fdeae77c for instance 86b60be9-fc62-44f1-92b5-39e259500d4e on hv-cinder-80952 Jan 28 00:57:38.190354 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-d97f0cd4-b405-4b45-bb6b-ba3fd08f2be7 req-3c432abd-aa36-4648-9a90-b53744a295bb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076637 Jan 28 00:57:38.192924 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 401/778] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:38.508777 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d6c57b47-f627-496d-9559-0acb81d766f2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:38.519690 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d6c57b47-f627-496d-9559-0acb81d766f2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1265 microversion: 2.1 time: 0.471764 Jan 28 00:57:38.520632 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 378/779] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:38 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1265 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:38.607988 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-b4c93420-8289-45bd-a715-c7423053feff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:38.609444 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-b4c93420-8289-45bd-a715-c7423053feff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:38.618256 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b4c93420-8289-45bd-a715-c7423053feff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:38.618819 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b4c93420-8289-45bd-a715-c7423053feff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:38.619739 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b4c93420-8289-45bd-a715-c7423053feff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:38.620216 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b4c93420-8289-45bd-a715-c7423053feff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:38.763382 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-b4c93420-8289-45bd-a715-c7423053feff tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 22881 microversion: 2.20 time: 0.163857 Jan 28 00:57:38.765164 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 402/780] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:38 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 22881 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:57:39.540486 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-98c89886-15c5-4367-b099-72f958612108 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:39.541496 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-98c89886-15c5-4367-b099-72f958612108 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:39.550172 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-98c89886-15c5-4367-b099-72f958612108 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:39.550783 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-98c89886-15c5-4367-b099-72f958612108 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:39.551687 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-98c89886-15c5-4367-b099-72f958612108 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:39.552074 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-98c89886-15c5-4367-b099-72f958612108 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:39.778191 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-a18cd533-6adb-45a6-a9c4-fa592d46e41e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:39.780788 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-a18cd533-6adb-45a6-a9c4-fa592d46e41e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:39.791981 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a18cd533-6adb-45a6-a9c4-fa592d46e41e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:39.792512 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a18cd533-6adb-45a6-a9c4-fa592d46e41e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:39.793560 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a18cd533-6adb-45a6-a9c4-fa592d46e41e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:39.794567 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a18cd533-6adb-45a6-a9c4-fa592d46e41e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:39.861512 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-98c89886-15c5-4367-b099-72f958612108 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:39.870659 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-98c89886-15c5-4367-b099-72f958612108 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1265 microversion: 2.1 time: 0.335403 Jan 28 00:57:39.871288 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 379/781] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:39 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1265 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:39.963470 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-a18cd533-6adb-45a6-a9c4-fa592d46e41e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 23787 microversion: 2.20 time: 0.189733 Jan 28 00:57:39.964714 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 403/782] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:39 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 23787 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:57:40.888524 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-29c6cb90-978d-421f-b32f-d967a71bbad2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:40.889781 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-29c6cb90-978d-421f-b32f-d967a71bbad2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:40.896545 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-29c6cb90-978d-421f-b32f-d967a71bbad2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:40.897013 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-29c6cb90-978d-421f-b32f-d967a71bbad2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:40.897825 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-29c6cb90-978d-421f-b32f-d967a71bbad2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:40.898274 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-29c6cb90-978d-421f-b32f-d967a71bbad2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:40.986640 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d402eab1-4ab9-4fb5-9381-d4b7569aa0d9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:40.987926 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d402eab1-4ab9-4fb5-9381-d4b7569aa0d9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:40.997096 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d402eab1-4ab9-4fb5-9381-d4b7569aa0d9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:40.997694 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d402eab1-4ab9-4fb5-9381-d4b7569aa0d9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:40.998776 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d402eab1-4ab9-4fb5-9381-d4b7569aa0d9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:40.999240 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d402eab1-4ab9-4fb5-9381-d4b7569aa0d9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:41.056261 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-29c6cb90-978d-421f-b32f-d967a71bbad2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:41.065272 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-29c6cb90-978d-421f-b32f-d967a71bbad2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1265 microversion: 2.1 time: 0.180650 Jan 28 00:57:41.066007 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 380/783] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:40 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:41.127811 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d402eab1-4ab9-4fb5-9381-d4b7569aa0d9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 24624 microversion: 2.20 time: 0.149101 Jan 28 00:57:41.128486 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 404/784] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:40 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 24624 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:57:42.085412 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e2226799-0f7a-4083-80b9-9a095cdebb63 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:42.086218 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e2226799-0f7a-4083-80b9-9a095cdebb63 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:42.093915 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e2226799-0f7a-4083-80b9-9a095cdebb63 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:42.094471 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e2226799-0f7a-4083-80b9-9a095cdebb63 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:42.095559 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e2226799-0f7a-4083-80b9-9a095cdebb63 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:42.096253 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e2226799-0f7a-4083-80b9-9a095cdebb63 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:42.142492 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-085dc72d-b75b-4781-85fe-a8cad69c2ff7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:42.143740 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-085dc72d-b75b-4781-85fe-a8cad69c2ff7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:42.151495 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-085dc72d-b75b-4781-85fe-a8cad69c2ff7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:42.152017 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-085dc72d-b75b-4781-85fe-a8cad69c2ff7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:42.152847 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-085dc72d-b75b-4781-85fe-a8cad69c2ff7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:42.153293 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-085dc72d-b75b-4781-85fe-a8cad69c2ff7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:42.267767 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e2226799-0f7a-4083-80b9-9a095cdebb63 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:42.279768 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e2226799-0f7a-4083-80b9-9a095cdebb63 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1265 microversion: 2.1 time: 0.198185 Jan 28 00:57:42.280896 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 381/785] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:42 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:43.299026 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b801679c-66bc-4ec5-b514-dac221d5eae4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:43.300131 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b801679c-66bc-4ec5-b514-dac221d5eae4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:43.306460 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b801679c-66bc-4ec5-b514-dac221d5eae4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:43.306922 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b801679c-66bc-4ec5-b514-dac221d5eae4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:43.307921 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b801679c-66bc-4ec5-b514-dac221d5eae4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:43.308400 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b801679c-66bc-4ec5-b514-dac221d5eae4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:43.488426 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b801679c-66bc-4ec5-b514-dac221d5eae4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:43.498526 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b801679c-66bc-4ec5-b514-dac221d5eae4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1265 microversion: 2.1 time: 0.204139 Jan 28 00:57:43.499149 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 382/786] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:43 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:44.515226 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-078da5e9-51e5-4018-9ae6-c8f8d5426544 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:44.516079 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-078da5e9-51e5-4018-9ae6-c8f8d5426544 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:44.522942 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-078da5e9-51e5-4018-9ae6-c8f8d5426544 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:44.523437 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-078da5e9-51e5-4018-9ae6-c8f8d5426544 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:44.524325 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-078da5e9-51e5-4018-9ae6-c8f8d5426544 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:44.524771 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-078da5e9-51e5-4018-9ae6-c8f8d5426544 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:44.685232 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-078da5e9-51e5-4018-9ae6-c8f8d5426544 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:44.696568 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-078da5e9-51e5-4018-9ae6-c8f8d5426544 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1265 microversion: 2.1 time: 0.185251 Jan 28 00:57:44.697144 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 383/787] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:44 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:45.183964 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-085dc72d-b75b-4781-85fe-a8cad69c2ff7 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 27562 microversion: 2.20 time: 3.046458 Jan 28 00:57:45.187329 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 405/788] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:42 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 27562 bytes in 3049 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:57:45.716412 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-84b07849-cf20-42a3-af22-6dd5b6f960cb tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:45.722666 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-84b07849-cf20-42a3-af22-6dd5b6f960cb tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:45.729911 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-84b07849-cf20-42a3-af22-6dd5b6f960cb tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:45.729911 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-84b07849-cf20-42a3-af22-6dd5b6f960cb tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:45.729911 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-84b07849-cf20-42a3-af22-6dd5b6f960cb tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:45.729911 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-84b07849-cf20-42a3-af22-6dd5b6f960cb tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:46.037991 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-84b07849-cf20-42a3-af22-6dd5b6f960cb tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:46.048841 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-84b07849-cf20-42a3-af22-6dd5b6f960cb tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1265 microversion: 2.1 time: 0.335765 Jan 28 00:57:46.050182 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 384/789] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:45 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1265 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:46.198295 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-330d3d53-3d76-49dd-92b8-537256927d75 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:46.199439 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-330d3d53-3d76-49dd-92b8-537256927d75 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:46.210849 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-330d3d53-3d76-49dd-92b8-537256927d75 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:46.211533 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-330d3d53-3d76-49dd-92b8-537256927d75 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:46.212600 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-330d3d53-3d76-49dd-92b8-537256927d75 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:46.213126 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-330d3d53-3d76-49dd-92b8-537256927d75 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:47.074825 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1ee546db-24c6-4fbb-b119-d3233767e7cc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:47.076177 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-1ee546db-24c6-4fbb-b119-d3233767e7cc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:47.082862 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1ee546db-24c6-4fbb-b119-d3233767e7cc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:47.083350 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1ee546db-24c6-4fbb-b119-d3233767e7cc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:47.084157 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1ee546db-24c6-4fbb-b119-d3233767e7cc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:47.084596 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1ee546db-24c6-4fbb-b119-d3233767e7cc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:47.242765 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-1ee546db-24c6-4fbb-b119-d3233767e7cc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:47.253295 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1ee546db-24c6-4fbb-b119-d3233767e7cc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1265 microversion: 2.1 time: 0.182585 Jan 28 00:57:47.253913 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 385/790] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:47 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:48.270630 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1a89b81d-f075-4560-8e81-a9a83663b611 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:48.271408 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-1a89b81d-f075-4560-8e81-a9a83663b611 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:48.279773 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1a89b81d-f075-4560-8e81-a9a83663b611 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:48.280235 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1a89b81d-f075-4560-8e81-a9a83663b611 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:48.281044 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1a89b81d-f075-4560-8e81-a9a83663b611 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:48.281492 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1a89b81d-f075-4560-8e81-a9a83663b611 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:48.447942 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-1a89b81d-f075-4560-8e81-a9a83663b611 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:48.457251 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1a89b81d-f075-4560-8e81-a9a83663b611 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1265 microversion: 2.1 time: 0.190153 Jan 28 00:57:48.458261 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 386/791] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:48 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:49.123452 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-330d3d53-3d76-49dd-92b8-537256927d75 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 27974 microversion: 2.20 time: 2.928384 Jan 28 00:57:49.124358 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 406/792] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:46 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 27974 bytes in 2932 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:57:49.476258 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-49719d95-4ff1-4940-ba1c-19cd4932a418 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:49.476972 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-49719d95-4ff1-4940-ba1c-19cd4932a418 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:49.485779 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-49719d95-4ff1-4940-ba1c-19cd4932a418 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:49.486224 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-49719d95-4ff1-4940-ba1c-19cd4932a418 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:49.487020 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-49719d95-4ff1-4940-ba1c-19cd4932a418 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:49.487493 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-49719d95-4ff1-4940-ba1c-19cd4932a418 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:49.545302 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-31e0cfe7-8ece-457c-a5cb-34707194ece0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:49.546611 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-31e0cfe7-8ece-457c-a5cb-34707194ece0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:49.555449 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-31e0cfe7-8ece-457c-a5cb-34707194ece0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:49.555978 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-31e0cfe7-8ece-457c-a5cb-34707194ece0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:49.556826 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-31e0cfe7-8ece-457c-a5cb-34707194ece0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:49.557536 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-31e0cfe7-8ece-457c-a5cb-34707194ece0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:49.589648 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-31e0cfe7-8ece-457c-a5cb-34707194ece0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048594 Jan 28 00:57:49.590288 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 407/793] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 00:57:49 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 00:57:49.640357 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-49719d95-4ff1-4940-ba1c-19cd4932a418 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:49.651099 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-49719d95-4ff1-4940-ba1c-19cd4932a418 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1265 microversion: 2.1 time: 0.178900 Jan 28 00:57:49.652240 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 387/794] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:49 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:49.654933 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-6ae514a4-c8fd-4587-b4de-11274ba64ac4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:49.655783 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-6ae514a4-c8fd-4587-b4de-11274ba64ac4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:49.662464 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6ae514a4-c8fd-4587-b4de-11274ba64ac4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:49.662962 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6ae514a4-c8fd-4587-b4de-11274ba64ac4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:49.663823 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6ae514a4-c8fd-4587-b4de-11274ba64ac4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:49.664245 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6ae514a4-c8fd-4587-b4de-11274ba64ac4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:49.692469 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-6ae514a4-c8fd-4587-b4de-11274ba64ac4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Going to try to terminate instance {{(pid=127862) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 00:57:49.780776 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-6ae514a4-c8fd-4587-b4de-11274ba64ac4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 204 len: 0 microversion: 2.1 time: 0.131633 Jan 28 00:57:49.782673 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 408/795] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 00:57:49 2022] DELETE /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 00:57:49.789625 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c7bf8dac-e944-4e11-a160-6e56530d01eb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:49.790292 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c7bf8dac-e944-4e11-a160-6e56530d01eb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:49.798581 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c7bf8dac-e944-4e11-a160-6e56530d01eb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:49.798955 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c7bf8dac-e944-4e11-a160-6e56530d01eb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:49.799824 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c7bf8dac-e944-4e11-a160-6e56530d01eb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:49.800282 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c7bf8dac-e944-4e11-a160-6e56530d01eb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:49.949322 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-c7bf8dac-e944-4e11-a160-6e56530d01eb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:49.957487 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c7bf8dac-e944-4e11-a160-6e56530d01eb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1674 microversion: 2.1 time: 0.171311 Jan 28 00:57:49.958313 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 388/796] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:49 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:50.137270 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ea81d997-b337-4f94-b22f-9bda6af546a3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:50.138652 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ea81d997-b337-4f94-b22f-9bda6af546a3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:50.147617 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ea81d997-b337-4f94-b22f-9bda6af546a3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:50.148041 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ea81d997-b337-4f94-b22f-9bda6af546a3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:50.148851 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ea81d997-b337-4f94-b22f-9bda6af546a3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:50.149490 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ea81d997-b337-4f94-b22f-9bda6af546a3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:50.285494 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ea81d997-b337-4f94-b22f-9bda6af546a3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 28209 microversion: 2.20 time: 0.152092 Jan 28 00:57:50.286172 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 409/797] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:50 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 28209 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:57:50.674026 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-222a3195-b514-4353-95cd-48b2a355e9d7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:50.674662 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-222a3195-b514-4353-95cd-48b2a355e9d7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:50.681779 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-222a3195-b514-4353-95cd-48b2a355e9d7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:50.682224 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-222a3195-b514-4353-95cd-48b2a355e9d7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:50.683079 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-222a3195-b514-4353-95cd-48b2a355e9d7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:50.683552 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-222a3195-b514-4353-95cd-48b2a355e9d7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:50.833558 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-222a3195-b514-4353-95cd-48b2a355e9d7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:50.841241 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-222a3195-b514-4353-95cd-48b2a355e9d7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1265 microversion: 2.1 time: 0.170995 Jan 28 00:57:50.841825 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 389/798] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:50 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:50.975323 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-65c9d634-889a-4a21-82a8-f1fa1c939bca tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:50.975970 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-65c9d634-889a-4a21-82a8-f1fa1c939bca tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:50.983297 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-65c9d634-889a-4a21-82a8-f1fa1c939bca tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:50.983759 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-65c9d634-889a-4a21-82a8-f1fa1c939bca tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:50.984589 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-65c9d634-889a-4a21-82a8-f1fa1c939bca tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:50.985038 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-65c9d634-889a-4a21-82a8-f1fa1c939bca tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:51.151066 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-65c9d634-889a-4a21-82a8-f1fa1c939bca tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:51.159326 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-65c9d634-889a-4a21-82a8-f1fa1c939bca tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1674 microversion: 2.1 time: 0.188085 Jan 28 00:57:51.159973 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 410/799] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:50 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1674 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:51.299652 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-cb603c17-52b8-4959-95a6-53cc7ac55ada tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:51.300702 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-cb603c17-52b8-4959-95a6-53cc7ac55ada tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:51.306824 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cb603c17-52b8-4959-95a6-53cc7ac55ada tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:51.307625 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cb603c17-52b8-4959-95a6-53cc7ac55ada tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:51.308492 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cb603c17-52b8-4959-95a6-53cc7ac55ada tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:51.308934 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cb603c17-52b8-4959-95a6-53cc7ac55ada tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:51.433695 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-cb603c17-52b8-4959-95a6-53cc7ac55ada tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 28209 microversion: 2.20 time: 0.138607 Jan 28 00:57:51.434366 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 390/800] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:51 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 28209 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:57:51.858563 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f7c36a81-dc61-4742-bd32-581b5d55ef27 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:51.859186 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f7c36a81-dc61-4742-bd32-581b5d55ef27 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:51.865835 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f7c36a81-dc61-4742-bd32-581b5d55ef27 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:51.866304 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f7c36a81-dc61-4742-bd32-581b5d55ef27 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:51.867141 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f7c36a81-dc61-4742-bd32-581b5d55ef27 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:51.867626 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f7c36a81-dc61-4742-bd32-581b5d55ef27 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:52.011720 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f7c36a81-dc61-4742-bd32-581b5d55ef27 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:52.020149 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f7c36a81-dc61-4742-bd32-581b5d55ef27 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1265 microversion: 2.1 time: 0.165936 Jan 28 00:57:52.020747 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 411/801] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:51 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:52.177770 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c2dc7bc1-2daa-48bf-927c-78584236bcb7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:52.178469 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c2dc7bc1-2daa-48bf-927c-78584236bcb7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:52.185865 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c2dc7bc1-2daa-48bf-927c-78584236bcb7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:52.186329 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c2dc7bc1-2daa-48bf-927c-78584236bcb7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:52.187125 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c2dc7bc1-2daa-48bf-927c-78584236bcb7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:52.187581 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c2dc7bc1-2daa-48bf-927c-78584236bcb7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:52.377735 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-c2dc7bc1-2daa-48bf-927c-78584236bcb7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:52.388946 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c2dc7bc1-2daa-48bf-927c-78584236bcb7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1674 microversion: 2.1 time: 0.214772 Jan 28 00:57:52.389811 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 391/802] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:52 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1674 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:52.445746 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-6edc91ae-42b8-4745-977c-b018446e94a2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:52.447156 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-6edc91ae-42b8-4745-977c-b018446e94a2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:52.460699 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6edc91ae-42b8-4745-977c-b018446e94a2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:52.461049 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6edc91ae-42b8-4745-977c-b018446e94a2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:52.462266 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6edc91ae-42b8-4745-977c-b018446e94a2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:52.462916 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6edc91ae-42b8-4745-977c-b018446e94a2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:52.596123 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-6edc91ae-42b8-4745-977c-b018446e94a2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 28209 microversion: 2.20 time: 0.153012 Jan 28 00:57:52.598835 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 392/803] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:52 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 28209 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:57:52.605867 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-508893e1-a852-49ff-afbf-2ed169ffd62b req-9213543d-bf65-4082-99c3-d10015faaa6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b60be9-fc62-44f1-92b5-39e259500d4e", "name": "network-vif-plugged", "status": "completed", "tag": "0e8e3177-3ed6-4af8-a70f-1fe9fdeae77c"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:52.607650 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:57:52.607650 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:57:52.615403 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-508893e1-a852-49ff-afbf-2ed169ffd62b req-9213543d-bf65-4082-99c3-d10015faaa6b service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:52.615854 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-508893e1-a852-49ff-afbf-2ed169ffd62b req-9213543d-bf65-4082-99c3-d10015faaa6b service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:52.627387 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-508893e1-a852-49ff-afbf-2ed169ffd62b req-9213543d-bf65-4082-99c3-d10015faaa6b service nova] Creating event network-vif-plugged:0e8e3177-3ed6-4af8-a70f-1fe9fdeae77c for instance 86b60be9-fc62-44f1-92b5-39e259500d4e on hv-cinder-80952 Jan 28 00:57:52.632613 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-508893e1-a852-49ff-afbf-2ed169ffd62b req-9213543d-bf65-4082-99c3-d10015faaa6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192486 Jan 28 00:57:52.633199 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 412/804] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:53.037428 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0182211f-4876-49d0-9d8d-cdd477d360a7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:53.038139 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0182211f-4876-49d0-9d8d-cdd477d360a7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:53.046267 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0182211f-4876-49d0-9d8d-cdd477d360a7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:53.046628 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0182211f-4876-49d0-9d8d-cdd477d360a7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:53.047472 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0182211f-4876-49d0-9d8d-cdd477d360a7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:53.047915 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0182211f-4876-49d0-9d8d-cdd477d360a7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:53.221857 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-0182211f-4876-49d0-9d8d-cdd477d360a7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:53.231353 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0182211f-4876-49d0-9d8d-cdd477d360a7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1265 microversion: 2.1 time: 0.197857 Jan 28 00:57:53.232252 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 393/805] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:53 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:53.418839 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-69416602-9e67-42eb-bd09-8437a5e2e41e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:53.420191 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-69416602-9e67-42eb-bd09-8437a5e2e41e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:53.429744 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-69416602-9e67-42eb-bd09-8437a5e2e41e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:53.430336 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-69416602-9e67-42eb-bd09-8437a5e2e41e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:53.431307 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-69416602-9e67-42eb-bd09-8437a5e2e41e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:53.431772 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-69416602-9e67-42eb-bd09-8437a5e2e41e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:53.585063 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-69416602-9e67-42eb-bd09-8437a5e2e41e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:53.594506 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-69416602-9e67-42eb-bd09-8437a5e2e41e tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1674 microversion: 2.1 time: 0.181001 Jan 28 00:57:53.595302 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 413/806] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:53 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:53.609740 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0d00e466-07a3-403e-959d-f8e0ad5cbd52 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:53.610677 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0d00e466-07a3-403e-959d-f8e0ad5cbd52 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:53.617686 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0d00e466-07a3-403e-959d-f8e0ad5cbd52 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:53.618149 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0d00e466-07a3-403e-959d-f8e0ad5cbd52 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:53.618960 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0d00e466-07a3-403e-959d-f8e0ad5cbd52 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:53.619444 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0d00e466-07a3-403e-959d-f8e0ad5cbd52 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:53.856080 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0d00e466-07a3-403e-959d-f8e0ad5cbd52 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 28499 microversion: 2.20 time: 0.250581 Jan 28 00:57:53.856783 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 394/807] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:53 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 28499 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:57:54.248373 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-cac5ea56-eac7-4e98-a631-fb536b95d31b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:54.249229 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-cac5ea56-eac7-4e98-a631-fb536b95d31b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:54.257055 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cac5ea56-eac7-4e98-a631-fb536b95d31b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:54.257055 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cac5ea56-eac7-4e98-a631-fb536b95d31b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:54.260158 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cac5ea56-eac7-4e98-a631-fb536b95d31b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:54.260158 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cac5ea56-eac7-4e98-a631-fb536b95d31b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:54.484738 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cac5ea56-eac7-4e98-a631-fb536b95d31b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:54.495216 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-cac5ea56-eac7-4e98-a631-fb536b95d31b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1265 microversion: 2.1 time: 0.250093 Jan 28 00:57:54.495891 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 414/808] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:54 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:54.612706 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-21a49964-1230-4a3d-b31d-31b74a8db58f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:54.613415 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-21a49964-1230-4a3d-b31d-31b74a8db58f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:54.620535 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-21a49964-1230-4a3d-b31d-31b74a8db58f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:54.620990 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-21a49964-1230-4a3d-b31d-31b74a8db58f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:54.621783 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-21a49964-1230-4a3d-b31d-31b74a8db58f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:54.622782 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-21a49964-1230-4a3d-b31d-31b74a8db58f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:54.727123 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-21a49964-1230-4a3d-b31d-31b74a8db58f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:54.739424 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-21a49964-1230-4a3d-b31d-31b74a8db58f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1606 microversion: 2.1 time: 0.131052 Jan 28 00:57:54.740608 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 395/809] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:54 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1606 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:54.851235 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-0e9ee02f-3f14-494a-af07-6bd1e2cbbe8c req-6886c08b-03b5-49a0-b9b9-3d940ad5b2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4dbbfd4-609c-4041-b0b5-b939f759eecd", "name": "network-vif-deleted", "tag": "ec21ff23-6b4d-4c5a-b463-a671e6aea7ed"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:54.853723 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:57:54.853723 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:57:54.868182 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-0e9ee02f-3f14-494a-af07-6bd1e2cbbe8c req-6886c08b-03b5-49a0-b9b9-3d940ad5b2a2 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:54.869961 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-567c54a5-839b-4e97-b0ac-c92d39620d14 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:54.871476 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-567c54a5-839b-4e97-b0ac-c92d39620d14 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:54.880235 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-567c54a5-839b-4e97-b0ac-c92d39620d14 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:54.880969 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-567c54a5-839b-4e97-b0ac-c92d39620d14 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:54.881956 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-567c54a5-839b-4e97-b0ac-c92d39620d14 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:54.882659 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-567c54a5-839b-4e97-b0ac-c92d39620d14 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:54.882953 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-0e9ee02f-3f14-494a-af07-6bd1e2cbbe8c req-6886c08b-03b5-49a0-b9b9-3d940ad5b2a2 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:54.905765 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-0e9ee02f-3f14-494a-af07-6bd1e2cbbe8c req-6886c08b-03b5-49a0-b9b9-3d940ad5b2a2 service nova] Creating event network-vif-deleted:ec21ff23-6b4d-4c5a-b463-a671e6aea7ed for instance a4dbbfd4-609c-4041-b0b5-b939f759eecd on hv-cinder-80952 Jan 28 00:57:54.916770 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-0e9ee02f-3f14-494a-af07-6bd1e2cbbe8c req-6886c08b-03b5-49a0-b9b9-3d940ad5b2a2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069197 Jan 28 00:57:54.917951 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 415/810] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:57:55.516706 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-8a1853f2-eb6c-4b8e-b8ac-0b2e7fe91b68 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:55.517416 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-8a1853f2-eb6c-4b8e-b8ac-0b2e7fe91b68 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:55.523781 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8a1853f2-eb6c-4b8e-b8ac-0b2e7fe91b68 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:55.524235 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8a1853f2-eb6c-4b8e-b8ac-0b2e7fe91b68 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:55.525035 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8a1853f2-eb6c-4b8e-b8ac-0b2e7fe91b68 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:55.525475 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8a1853f2-eb6c-4b8e-b8ac-0b2e7fe91b68 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:55.676649 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-8a1853f2-eb6c-4b8e-b8ac-0b2e7fe91b68 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:55.684192 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-8a1853f2-eb6c-4b8e-b8ac-0b2e7fe91b68 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1265 microversion: 2.1 time: 0.173197 Jan 28 00:57:55.685500 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 416/811] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:55 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:55.757953 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-27483577-37e6-440a-b389-ef0bdaa47c92 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:55.758700 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-27483577-37e6-440a-b389-ef0bdaa47c92 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:55.766636 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-27483577-37e6-440a-b389-ef0bdaa47c92 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:55.767341 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-27483577-37e6-440a-b389-ef0bdaa47c92 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:55.768311 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-27483577-37e6-440a-b389-ef0bdaa47c92 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:55.768937 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-27483577-37e6-440a-b389-ef0bdaa47c92 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:55.834412 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-27483577-37e6-440a-b389-ef0bdaa47c92 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:55.843167 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-27483577-37e6-440a-b389-ef0bdaa47c92 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1606 microversion: 2.1 time: 0.089030 Jan 28 00:57:55.843832 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 417/812] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:55 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1606 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:56.702405 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7ffc5b22-71c8-4add-bd68-18fe7bfcccc2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:56.703059 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7ffc5b22-71c8-4add-bd68-18fe7bfcccc2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:56.709798 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7ffc5b22-71c8-4add-bd68-18fe7bfcccc2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:56.710355 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7ffc5b22-71c8-4add-bd68-18fe7bfcccc2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:56.711180 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7ffc5b22-71c8-4add-bd68-18fe7bfcccc2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:56.711556 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7ffc5b22-71c8-4add-bd68-18fe7bfcccc2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:56.874707 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7ffc5b22-71c8-4add-bd68-18fe7bfcccc2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:56.882552 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7ffc5b22-71c8-4add-bd68-18fe7bfcccc2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1265 microversion: 2.1 time: 0.184559 Jan 28 00:57:56.883148 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 418/813] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:56 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:56.887523 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-0196c189-7b2d-4d40-8d80-f73a1fed1fb1 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:56.888893 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-0196c189-7b2d-4d40-8d80-f73a1fed1fb1 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:56.895323 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0196c189-7b2d-4d40-8d80-f73a1fed1fb1 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:56.895785 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0196c189-7b2d-4d40-8d80-f73a1fed1fb1 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:56.897707 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0196c189-7b2d-4d40-8d80-f73a1fed1fb1 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:56.897707 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0196c189-7b2d-4d40-8d80-f73a1fed1fb1 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:56.968322 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-0196c189-7b2d-4d40-8d80-f73a1fed1fb1 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:56.978405 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-0196c189-7b2d-4d40-8d80-f73a1fed1fb1 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1322 microversion: 2.1 time: 0.094157 Jan 28 00:57:56.979024 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 419/814] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:56 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1322 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:57.905718 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-a37af67f-4ac1-46eb-953c-ce0fe93846b6 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:57.905718 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-a37af67f-4ac1-46eb-953c-ce0fe93846b6 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:57.908499 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a37af67f-4ac1-46eb-953c-ce0fe93846b6 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:57.908976 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a37af67f-4ac1-46eb-953c-ce0fe93846b6 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:57.909786 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a37af67f-4ac1-46eb-953c-ce0fe93846b6 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:57.910238 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a37af67f-4ac1-46eb-953c-ce0fe93846b6 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:57.965889 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-567c54a5-839b-4e97-b0ac-c92d39620d14 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 28667 microversion: 2.20 time: 3.099879 Jan 28 00:57:57.966738 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 396/815] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:54 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 28667 bytes in 3102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:57:58.000035 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a9fa8a0a-37e0-4ce6-ad0d-bfa718c3cc90 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:58.001528 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a9fa8a0a-37e0-4ce6-ad0d-bfa718c3cc90 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:58.012957 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a9fa8a0a-37e0-4ce6-ad0d-bfa718c3cc90 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:58.013766 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a9fa8a0a-37e0-4ce6-ad0d-bfa718c3cc90 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:58.015482 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a9fa8a0a-37e0-4ce6-ad0d-bfa718c3cc90 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:58.016271 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a9fa8a0a-37e0-4ce6-ad0d-bfa718c3cc90 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:58.065742 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a9fa8a0a-37e0-4ce6-ad0d-bfa718c3cc90 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:58.066316 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a9fa8a0a-37e0-4ce6-ad0d-bfa718c3cc90 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:58.066860 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.objects.instance [None req-a9fa8a0a-37e0-4ce6-ad0d-bfa718c3cc90 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lazy-loading 'fault' on Instance uuid a4dbbfd4-609c-4041-b0b5-b939f759eecd {{(pid=127863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:57:58.144812 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a9fa8a0a-37e0-4ce6-ad0d-bfa718c3cc90 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:58.154711 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-a37af67f-4ac1-46eb-953c-ce0fe93846b6 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:58.155209 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a9fa8a0a-37e0-4ce6-ad0d-bfa718c3cc90 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 200 len: 1327 microversion: 2.1 time: 0.162487 Jan 28 00:57:58.156277 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 397/816] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:57 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 1327 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:58.163471 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-a37af67f-4ac1-46eb-953c-ce0fe93846b6 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1265 microversion: 2.1 time: 0.266206 Jan 28 00:57:58.164079 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 420/817] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:57 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:57:58.980322 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b3717138-62d1-48a4-bec4-92315a892f80 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:57:58.981723 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b3717138-62d1-48a4-bec4-92315a892f80 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:58.990762 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b3717138-62d1-48a4-bec4-92315a892f80 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:58.991314 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b3717138-62d1-48a4-bec4-92315a892f80 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:58.992214 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b3717138-62d1-48a4-bec4-92315a892f80 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:58.992725 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b3717138-62d1-48a4-bec4-92315a892f80 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:59.110868 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b3717138-62d1-48a4-bec4-92315a892f80 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 28667 microversion: 2.20 time: 0.134772 Jan 28 00:57:59.111469 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 398/818] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:57:58 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 28667 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:57:59.178221 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-83d5424a-3af1-4020-acc8-4f2afa645f21 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:59.178943 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-83d5424a-3af1-4020-acc8-4f2afa645f21 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:59.188454 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-83d5424a-3af1-4020-acc8-4f2afa645f21 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:59.189177 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-83d5424a-3af1-4020-acc8-4f2afa645f21 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:59.190445 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-83d5424a-3af1-4020-acc8-4f2afa645f21 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:59.191192 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-83d5424a-3af1-4020-acc8-4f2afa645f21 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:59.192359 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-9dd0a598-b809-4f56-9e24-e48eb3dc9b77 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:59.193627 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-9dd0a598-b809-4f56-9e24-e48eb3dc9b77 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:59.203206 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9dd0a598-b809-4f56-9e24-e48eb3dc9b77 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:59.203699 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9dd0a598-b809-4f56-9e24-e48eb3dc9b77 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:59.204530 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9dd0a598-b809-4f56-9e24-e48eb3dc9b77 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:59.204983 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9dd0a598-b809-4f56-9e24-e48eb3dc9b77 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:59.392875 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-83d5424a-3af1-4020-acc8-4f2afa645f21 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] HTTP exception thrown: Instance a4dbbfd4-609c-4041-b0b5-b939f759eecd could not be found. Jan 28 00:57:59.393464 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-83d5424a-3af1-4020-acc8-4f2afa645f21 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Returning 404 to user: Instance a4dbbfd4-609c-4041-b0b5-b939f759eecd could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:57:59.394454 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-83d5424a-3af1-4020-acc8-4f2afa645f21 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 404 len: 111 microversion: 2.1 time: 0.220980 Jan 28 00:57:59.395097 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 421/819] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:59 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:57:59.405549 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1427736d-3ea0-413a-a3de-ca43236fb0d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '.version_select at 0x7fbbc21243a0>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:59.406865 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-9dd0a598-b809-4f56-9e24-e48eb3dc9b77 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:59.416035 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-9dd0a598-b809-4f56-9e24-e48eb3dc9b77 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1452 microversion: 2.1 time: 0.231253 Jan 28 00:57:59.416813 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 399/820] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:59 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1452 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:57:59.436309 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1427736d-3ea0-413a-a3de-ca43236fb0d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-905234909" status: 202 len: 0 microversion: 2.1 time: 0.035281 Jan 28 00:57:59.437462 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 422/821] 10.222.0.25 () {58 vars in 1217 bytes} [Fri Jan 28 00:57:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-905234909 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:57:59.437900 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-66b1f2f7-08e7-4de4-8d62-e2043b00a2aa tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:57:59.439876 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-66b1f2f7-08e7-4de4-8d62-e2043b00a2aa tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:57:59.448464 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-66b1f2f7-08e7-4de4-8d62-e2043b00a2aa tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:59.448803 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-66b1f2f7-08e7-4de4-8d62-e2043b00a2aa tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:59.450028 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-66b1f2f7-08e7-4de4-8d62-e2043b00a2aa tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:57:59.450646 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-66b1f2f7-08e7-4de4-8d62-e2043b00a2aa tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:57:59.655234 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-66b1f2f7-08e7-4de4-8d62-e2043b00a2aa tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:57:59.668100 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-66b1f2f7-08e7-4de4-8d62-e2043b00a2aa tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1452 microversion: 2.1 time: 0.236633 Jan 28 00:57:59.669775 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 400/822] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:57:59 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1452 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:00.127151 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-cf7ca1f3-16fd-4cc8-adcf-603e8b5292bc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:00.129840 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-cf7ca1f3-16fd-4cc8-adcf-603e8b5292bc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:00.145168 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf7ca1f3-16fd-4cc8-adcf-603e8b5292bc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:00.146041 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf7ca1f3-16fd-4cc8-adcf-603e8b5292bc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:00.147209 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf7ca1f3-16fd-4cc8-adcf-603e8b5292bc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:00.147871 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cf7ca1f3-16fd-4cc8-adcf-603e8b5292bc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:00.265683 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-cf7ca1f3-16fd-4cc8-adcf-603e8b5292bc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 28667 microversion: 2.20 time: 0.144512 Jan 28 00:58:00.267579 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 423/823] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:00 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 28667 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:00.467667 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4be86160-b7bc-43fa-ba5b-237e933bcdd4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'create', calling method: .version_select at 0x7fbbc2208310>, body: {"keypair": {"name": "tempest-keypair-1890601314"}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:00.488899 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-4be86160-b7bc-43fa-ba5b-237e933bcdd4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Getting quotas for project 3e774ad4314a49b4a0a8db735e0d8424. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:58:00.496362 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-4be86160-b7bc-43fa-ba5b-237e933bcdd4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Getting quotas for user 3f7380dfc9f44ee2acddd560f1968989 and project 3e774ad4314a49b4a0a8db735e0d8424. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:58:00.631207 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-4be86160-b7bc-43fa-ba5b-237e933bcdd4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Getting quotas for project 3e774ad4314a49b4a0a8db735e0d8424. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:58:00.644676 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-4be86160-b7bc-43fa-ba5b-237e933bcdd4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Getting quotas for user 3f7380dfc9f44ee2acddd560f1968989 and project 3e774ad4314a49b4a0a8db735e0d8424. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:58:00.668418 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4be86160-b7bc-43fa-ba5b-237e933bcdd4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.207895 Jan 28 00:58:00.669711 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 401/824] 10.222.0.25 () {60 vars in 1157 bytes} [Fri Jan 28 00:58:00 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:01.285158 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-da5e3fca-78d8-4326-8ef8-a08fb2339c47 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:01.287991 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-da5e3fca-78d8-4326-8ef8-a08fb2339c47 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:01.301268 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-da5e3fca-78d8-4326-8ef8-a08fb2339c47 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:01.302233 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-da5e3fca-78d8-4326-8ef8-a08fb2339c47 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:01.303999 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-da5e3fca-78d8-4326-8ef8-a08fb2339c47 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:01.304928 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-da5e3fca-78d8-4326-8ef8-a08fb2339c47 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:01.481270 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-da5e3fca-78d8-4326-8ef8-a08fb2339c47 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 28667 microversion: 2.20 time: 0.196899 Jan 28 00:58:01.486309 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 424/825] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:01 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 28667 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:02.459528 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-d4832155-3f4f-40ea-92c9-5bd6a813ec2b req-03ccacac-766e-4a7f-9c6f-6cc55c22b0cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b60be9-fc62-44f1-92b5-39e259500d4e", "tag": "0e8e3177-3ed6-4af8-a70f-1fe9fdeae77c"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:02.461885 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:58:02.461885 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:58:02.477896 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-d4832155-3f4f-40ea-92c9-5bd6a813ec2b req-03ccacac-766e-4a7f-9c6f-6cc55c22b0cd service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:02.479141 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-d4832155-3f4f-40ea-92c9-5bd6a813ec2b req-03ccacac-766e-4a7f-9c6f-6cc55c22b0cd service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:02.510769 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4ca5b1ea-4878-4cbb-a977-b0d4065617d1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:02.513477 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4ca5b1ea-4878-4cbb-a977-b0d4065617d1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:02.529558 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-d4832155-3f4f-40ea-92c9-5bd6a813ec2b req-03ccacac-766e-4a7f-9c6f-6cc55c22b0cd service nova] Creating event network-changed:0e8e3177-3ed6-4af8-a70f-1fe9fdeae77c for instance 86b60be9-fc62-44f1-92b5-39e259500d4e on hv-cinder-80952 Jan 28 00:58:02.536434 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4ca5b1ea-4878-4cbb-a977-b0d4065617d1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:02.537104 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4ca5b1ea-4878-4cbb-a977-b0d4065617d1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:02.538182 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4ca5b1ea-4878-4cbb-a977-b0d4065617d1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:02.538619 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4ca5b1ea-4878-4cbb-a977-b0d4065617d1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:02.542051 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-d4832155-3f4f-40ea-92c9-5bd6a813ec2b req-03ccacac-766e-4a7f-9c6f-6cc55c22b0cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209128 Jan 28 00:58:02.543431 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 402/826] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:58:02.654760 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4ca5b1ea-4878-4cbb-a977-b0d4065617d1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 28667 microversion: 2.20 time: 0.158603 Jan 28 00:58:02.661076 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 425/827] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:02 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 28667 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:58:03.020185 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-67d42239-66e2-4d02-bd0e-eaed9cbc617c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1840280890", "imageRef": "7fe09c59-2ff9-4639-b39d-9a474e83ad91", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6354805f-672a-4641-babe-b974486e9fdf"}], "security_groups": [{"name": "tempest-securitygroup--312342236"}], "key_name": "tempest-keypair-1890601314", "user_data": "}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:03.300413 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.network.neutron [None req-67d42239-66e2-4d02-bd0e-eaed9cbc617c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] validate_networks() for [('6354805f-672a-4641-babe-b974486e9fdf', None, None, None, None, None)] {{(pid=127863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:58:03.673776 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1804926c-1ffb-47a8-b5ff-803a2a4dc260 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:03.679415 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1804926c-1ffb-47a8-b5ff-803a2a4dc260 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:03.692914 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1804926c-1ffb-47a8-b5ff-803a2a4dc260 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:03.693984 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1804926c-1ffb-47a8-b5ff-803a2a4dc260 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:03.695848 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1804926c-1ffb-47a8-b5ff-803a2a4dc260 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:03.696475 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1804926c-1ffb-47a8-b5ff-803a2a4dc260 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:03.874130 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1804926c-1ffb-47a8-b5ff-803a2a4dc260 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 29591 microversion: 2.20 time: 0.207326 Jan 28 00:58:03.880378 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 426/828] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:03 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 29591 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:04.474778 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-67d42239-66e2-4d02-bd0e-eaed9cbc617c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Flavor limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:58:04.475604 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-67d42239-66e2-4d02-bd0e-eaed9cbc617c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Image limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:58:04.476117 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-67d42239-66e2-4d02-bd0e-eaed9cbc617c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Flavor pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:58:04.476564 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-67d42239-66e2-4d02-bd0e-eaed9cbc617c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Image pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:58:04.477075 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-67d42239-66e2-4d02-bd0e-eaed9cbc617c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:58:04.496984 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-67d42239-66e2-4d02-bd0e-eaed9cbc617c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:04.496984 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-67d42239-66e2-4d02-bd0e-eaed9cbc617c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:04.496984 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-67d42239-66e2-4d02-bd0e-eaed9cbc617c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:04.496984 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-67d42239-66e2-4d02-bd0e-eaed9cbc617c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:04.513684 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-67d42239-66e2-4d02-bd0e-eaed9cbc617c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Getting quotas for project 3e774ad4314a49b4a0a8db735e0d8424. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:58:04.520368 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-67d42239-66e2-4d02-bd0e-eaed9cbc617c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Getting quotas for user 3f7380dfc9f44ee2acddd560f1968989 and project 3e774ad4314a49b4a0a8db735e0d8424. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:58:04.536473 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-67d42239-66e2-4d02-bd0e-eaed9cbc617c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Going to run 1 instances... {{(pid=127863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:58:04.539032 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-67d42239-66e2-4d02-bd0e-eaed9cbc617c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fe09c59-2ff9-4639-b39d-9a474e83ad91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:58:04.582246 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-55b81521-5a4f-40bc-a927-370c9adda814 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-74325339"}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:04.583255 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-55b81521-5a4f-40bc-a927-370c9adda814 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:04.592025 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-55b81521-5a4f-40bc-a927-370c9adda814 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:04.592816 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-55b81521-5a4f-40bc-a927-370c9adda814 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:04.594128 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-55b81521-5a4f-40bc-a927-370c9adda814 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:04.594575 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-55b81521-5a4f-40bc-a927-370c9adda814 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:04.600434 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-67d42239-66e2-4d02-bd0e-eaed9cbc617c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.589734 Jan 28 00:58:04.601337 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 403/829] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 00:58:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 00:58:04.612939 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4cc5d062-86df-41de-8739-db93efe67612 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:04.613460 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4cc5d062-86df-41de-8739-db93efe67612 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:04.684012 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4cc5d062-86df-41de-8739-db93efe67612 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:04.707818 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4cc5d062-86df-41de-8739-db93efe67612 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 200 len: 1238 microversion: 2.1 time: 0.098320 Jan 28 00:58:04.709274 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 404/830] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:04 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 1238 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:04.855498 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.network.security_group_api [None req-55b81521-5a4f-40bc-a927-370c9adda814 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Removing security group abaaa437-af46-4323-aff7-2b12df14201e from port 1f359392-df9f-424a-b687-8308d8dcbece Jan 28 00:58:04.889204 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4deb5fb7-7c86-4b50-a868-d9d821c3961e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:04.890535 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4deb5fb7-7c86-4b50-a868-d9d821c3961e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:04.897418 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4deb5fb7-7c86-4b50-a868-d9d821c3961e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:04.897872 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4deb5fb7-7c86-4b50-a868-d9d821c3961e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:04.898896 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4deb5fb7-7c86-4b50-a868-d9d821c3961e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:04.899361 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4deb5fb7-7c86-4b50-a868-d9d821c3961e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:05.030873 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4deb5fb7-7c86-4b50-a868-d9d821c3961e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 31142 microversion: 2.20 time: 0.147168 Jan 28 00:58:05.032568 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 405/831] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:04 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 31142 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:58:05.462835 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-55b81521-5a4f-40bc-a927-370c9adda814 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "POST /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785/action" status: 202 len: 0 microversion: 2.1 time: 0.886697 Jan 28 00:58:05.472140 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-b57d9e0d-50d2-4771-9b66-cdd1bd28ea69 req-302aab58-bdb6-4a7f-ade7-e77ae8636203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "060e1452-5aba-4323-894d-a04d6aed8785", "tag": "1f359392-df9f-424a-b687-8308d8dcbece"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:05.474125 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:58:05.474125 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:58:05.476501 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 427/832] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:04 2022] POST /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785/action => generated 0 bytes in 902 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:05.488943 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-b57d9e0d-50d2-4771-9b66-cdd1bd28ea69 req-302aab58-bdb6-4a7f-ade7-e77ae8636203 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:05.495071 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-b57d9e0d-50d2-4771-9b66-cdd1bd28ea69 req-302aab58-bdb6-4a7f-ade7-e77ae8636203 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:05.533630 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-b57d9e0d-50d2-4771-9b66-cdd1bd28ea69 req-302aab58-bdb6-4a7f-ade7-e77ae8636203 service nova] Creating event network-changed:1f359392-df9f-424a-b687-8308d8dcbece for instance 060e1452-5aba-4323-894d-a04d6aed8785 on hv-cinder-80952 Jan 28 00:58:05.540729 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-b57d9e0d-50d2-4771-9b66-cdd1bd28ea69 req-302aab58-bdb6-4a7f-ade7-e77ae8636203 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073190 Jan 28 00:58:05.542137 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 406/833] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:58:05.748329 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4c5d09d8-4038-45e4-8a26-136f09b181b7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:05.749709 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4c5d09d8-4038-45e4-8a26-136f09b181b7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:05.768428 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c5d09d8-4038-45e4-8a26-136f09b181b7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:05.769454 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c5d09d8-4038-45e4-8a26-136f09b181b7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:05.787812 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c5d09d8-4038-45e4-8a26-136f09b181b7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:05.788292 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c5d09d8-4038-45e4-8a26-136f09b181b7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:05.998976 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4c5d09d8-4038-45e4-8a26-136f09b181b7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:06.016790 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4c5d09d8-4038-45e4-8a26-136f09b181b7 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 200 len: 1290 microversion: 2.1 time: 0.287849 Jan 28 00:58:06.038836 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 428/834] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:05 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 1290 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:06.046009 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-daa5f14a-1d51-4acc-8365-d025c31cf88c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:06.047381 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-daa5f14a-1d51-4acc-8365-d025c31cf88c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:06.057528 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-daa5f14a-1d51-4acc-8365-d025c31cf88c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:06.058262 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-daa5f14a-1d51-4acc-8365-d025c31cf88c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:06.059363 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-daa5f14a-1d51-4acc-8365-d025c31cf88c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:06.060696 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-daa5f14a-1d51-4acc-8365-d025c31cf88c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:06.315585 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-daa5f14a-1d51-4acc-8365-d025c31cf88c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 32280 microversion: 2.20 time: 0.276052 Jan 28 00:58:06.321527 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 407/835] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:06 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 32280 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:07.047670 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-126fdfc7-2b6e-41b9-828a-37922b829440 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:07.048320 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-126fdfc7-2b6e-41b9-828a-37922b829440 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:07.056925 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-126fdfc7-2b6e-41b9-828a-37922b829440 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:07.057390 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-126fdfc7-2b6e-41b9-828a-37922b829440 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:07.058454 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-126fdfc7-2b6e-41b9-828a-37922b829440 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:07.059090 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-126fdfc7-2b6e-41b9-828a-37922b829440 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:07.160520 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-126fdfc7-2b6e-41b9-828a-37922b829440 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:07.174549 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-126fdfc7-2b6e-41b9-828a-37922b829440 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 200 len: 1296 microversion: 2.1 time: 0.136086 Jan 28 00:58:07.180375 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 429/836] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:07 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 1296 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:07.337019 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-12a79c23-6f64-44c5-8b0d-fa1a8dbdbccf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:07.339205 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-12a79c23-6f64-44c5-8b0d-fa1a8dbdbccf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:07.353715 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-12a79c23-6f64-44c5-8b0d-fa1a8dbdbccf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:07.354845 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-12a79c23-6f64-44c5-8b0d-fa1a8dbdbccf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:07.356104 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-12a79c23-6f64-44c5-8b0d-fa1a8dbdbccf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:07.357045 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-12a79c23-6f64-44c5-8b0d-fa1a8dbdbccf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:07.504329 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-12a79c23-6f64-44c5-8b0d-fa1a8dbdbccf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 32931 microversion: 2.20 time: 0.176298 Jan 28 00:58:07.505302 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 408/837] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:07 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 32931 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:08.166505 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3bfc7f3a-6bf3-4851-95a4-e4e5940e6ab7 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:08.167434 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3bfc7f3a-6bf3-4851-95a4-e4e5940e6ab7 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:08.174542 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-8185b67e-7afa-47c9-90ad-888e8b0b0710 req-38d9656d-d374-4bed-b9ee-0e987033cb6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "060e1452-5aba-4323-894d-a04d6aed8785", "tag": "1f359392-df9f-424a-b687-8308d8dcbece"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:08.177860 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:58:08.177860 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:58:08.198477 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3bfc7f3a-6bf3-4851-95a4-e4e5940e6ab7 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:08.199380 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3bfc7f3a-6bf3-4851-95a4-e4e5940e6ab7 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:08.200897 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3bfc7f3a-6bf3-4851-95a4-e4e5940e6ab7 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:08.201759 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3bfc7f3a-6bf3-4851-95a4-e4e5940e6ab7 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:08.216633 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-8185b67e-7afa-47c9-90ad-888e8b0b0710 req-38d9656d-d374-4bed-b9ee-0e987033cb6b service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:08.222700 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-8185b67e-7afa-47c9-90ad-888e8b0b0710 req-38d9656d-d374-4bed-b9ee-0e987033cb6b service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:08.256189 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-8185b67e-7afa-47c9-90ad-888e8b0b0710 req-38d9656d-d374-4bed-b9ee-0e987033cb6b service nova] Creating event network-changed:1f359392-df9f-424a-b687-8308d8dcbece for instance 060e1452-5aba-4323-894d-a04d6aed8785 on hv-cinder-80952 Jan 28 00:58:08.290562 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-8185b67e-7afa-47c9-90ad-888e8b0b0710 req-38d9656d-d374-4bed-b9ee-0e987033cb6b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131615 Jan 28 00:58:08.292274 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 409/838] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:58:08.358015 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.objects.instance [None req-3bfc7f3a-6bf3-4851-95a4-e4e5940e6ab7 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lazy-loading 'services' on Instance uuid 060e1452-5aba-4323-894d-a04d6aed8785 {{(pid=127862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:58:08.567965 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3bfc7f3a-6bf3-4851-95a4-e4e5940e6ab7 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "DELETE /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785/os-volume_attachments/1b804850-37bf-465e-88ad-c55c312ceee1" status: 202 len: 0 microversion: 2.1 time: 0.411159 Jan 28 00:58:08.572158 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 430/839] 10.222.0.25 () {58 vars in 1415 bytes} [Fri Jan 28 00:58:08 2022] DELETE /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785/os-volume_attachments/1b804850-37bf-465e-88ad-c55c312ceee1 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:08.604961 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-627dfe9f-ce53-481e-b998-5cc0e8064e5c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:08.636260 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-627dfe9f-ce53-481e-b998-5cc0e8064e5c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:08.658237 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-627dfe9f-ce53-481e-b998-5cc0e8064e5c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:08.658883 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-627dfe9f-ce53-481e-b998-5cc0e8064e5c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:08.660150 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-627dfe9f-ce53-481e-b998-5cc0e8064e5c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:08.660734 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-627dfe9f-ce53-481e-b998-5cc0e8064e5c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:08.785774 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-43107c41-59fb-4453-ae73-99a31c537587 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:08.785774 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-43107c41-59fb-4453-ae73-99a31c537587 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:08.798169 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-43107c41-59fb-4453-ae73-99a31c537587 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:08.799788 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-43107c41-59fb-4453-ae73-99a31c537587 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:08.801676 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-43107c41-59fb-4453-ae73-99a31c537587 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:08.802817 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-43107c41-59fb-4453-ae73-99a31c537587 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:08.818199 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-627dfe9f-ce53-481e-b998-5cc0e8064e5c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 33607 microversion: 2.20 time: 0.242928 Jan 28 00:58:08.820044 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 431/840] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:08 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 33607 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:08.839587 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-dfd9b799-ca8e-421a-88de-951b9312f836 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:08.845530 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-dfd9b799-ca8e-421a-88de-951b9312f836 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:08.859154 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-dfd9b799-ca8e-421a-88de-951b9312f836 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:08.860269 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-dfd9b799-ca8e-421a-88de-951b9312f836 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:08.862558 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-dfd9b799-ca8e-421a-88de-951b9312f836 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:08.863637 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-dfd9b799-ca8e-421a-88de-951b9312f836 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:08.917497 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-dfd9b799-ca8e-421a-88de-951b9312f836 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087959 Jan 28 00:58:08.923131 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 432/841] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 00:58:08 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:58:09.148287 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-43107c41-59fb-4453-ae73-99a31c537587 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:09.178687 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-43107c41-59fb-4453-ae73-99a31c537587 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 200 len: 1363 microversion: 2.1 time: 0.883850 Jan 28 00:58:09.179802 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 410/842] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:08 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 1363 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:09.839539 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-c6f014e3-1f96-40f0-8a4c-8cdb8344fc1b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:09.849635 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-c6f014e3-1f96-40f0-8a4c-8cdb8344fc1b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:09.877671 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c6f014e3-1f96-40f0-8a4c-8cdb8344fc1b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:09.878453 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c6f014e3-1f96-40f0-8a4c-8cdb8344fc1b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:09.879912 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c6f014e3-1f96-40f0-8a4c-8cdb8344fc1b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:09.881434 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c6f014e3-1f96-40f0-8a4c-8cdb8344fc1b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:09.931809 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-feef20c4-eb21-4e95-a0f8-e0dbb1351c91 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:09.932930 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-feef20c4-eb21-4e95-a0f8-e0dbb1351c91 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:09.949348 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-feef20c4-eb21-4e95-a0f8-e0dbb1351c91 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:09.949348 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-feef20c4-eb21-4e95-a0f8-e0dbb1351c91 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:09.958376 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-feef20c4-eb21-4e95-a0f8-e0dbb1351c91 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:09.958845 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-feef20c4-eb21-4e95-a0f8-e0dbb1351c91 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:10.020227 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-feef20c4-eb21-4e95-a0f8-e0dbb1351c91 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092875 Jan 28 00:58:10.021376 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 411/843] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 00:58:09 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:58:10.102162 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-c6f014e3-1f96-40f0-8a4c-8cdb8344fc1b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 34416 microversion: 2.20 time: 0.271984 Jan 28 00:58:10.104260 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 433/844] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:09 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 34416 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:10.208961 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b86c0856-d161-4c97-b3ff-5b9af6dd45aa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:10.210366 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b86c0856-d161-4c97-b3ff-5b9af6dd45aa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:10.234585 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b86c0856-d161-4c97-b3ff-5b9af6dd45aa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:10.241169 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b86c0856-d161-4c97-b3ff-5b9af6dd45aa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:10.242452 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b86c0856-d161-4c97-b3ff-5b9af6dd45aa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:10.243050 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b86c0856-d161-4c97-b3ff-5b9af6dd45aa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:10.364800 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-ab5d9350-d4ea-4170-8553-89afc58d86c1 req-a5fd32d8-ff02-4f70-b995-c7dac798b914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64723bd1-f578-4d8a-b562-971874536f1d", "tag": "8839566b-538e-4d4a-b002-3de919d10b4d"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:10.369524 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:58:10.369524 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:58:10.395380 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-ab5d9350-d4ea-4170-8553-89afc58d86c1 req-a5fd32d8-ff02-4f70-b995-c7dac798b914 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:10.396587 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-ab5d9350-d4ea-4170-8553-89afc58d86c1 req-a5fd32d8-ff02-4f70-b995-c7dac798b914 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:10.424877 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-ab5d9350-d4ea-4170-8553-89afc58d86c1 req-a5fd32d8-ff02-4f70-b995-c7dac798b914 service nova] Creating event network-changed:8839566b-538e-4d4a-b002-3de919d10b4d for instance 64723bd1-f578-4d8a-b562-971874536f1d on hv-cinder-80952 Jan 28 00:58:10.437646 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-ab5d9350-d4ea-4170-8553-89afc58d86c1 req-a5fd32d8-ff02-4f70-b995-c7dac798b914 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084922 Jan 28 00:58:10.439312 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 434/845] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:58:10.483951 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b86c0856-d161-4c97-b3ff-5b9af6dd45aa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:10.496675 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b86c0856-d161-4c97-b3ff-5b9af6dd45aa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 200 len: 1363 microversion: 2.1 time: 0.295164 Jan 28 00:58:10.497354 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 412/846] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:10 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 1363 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:11.040223 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-333b38bb-487f-429c-b366-3a3255fe5556 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:11.042205 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-333b38bb-487f-429c-b366-3a3255fe5556 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:11.051227 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-333b38bb-487f-429c-b366-3a3255fe5556 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:11.051986 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-333b38bb-487f-429c-b366-3a3255fe5556 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:11.053018 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-333b38bb-487f-429c-b366-3a3255fe5556 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:11.053492 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-333b38bb-487f-429c-b366-3a3255fe5556 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:11.096039 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-333b38bb-487f-429c-b366-3a3255fe5556 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063338 Jan 28 00:58:11.096657 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 435/847] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 00:58:11 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:58:11.108432 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0b56b5a3-89a4-4575-b3b7-f5d3dee0ec08 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:11.109330 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0b56b5a3-89a4-4575-b3b7-f5d3dee0ec08 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:11.118150 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0b56b5a3-89a4-4575-b3b7-f5d3dee0ec08 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:11.118679 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0b56b5a3-89a4-4575-b3b7-f5d3dee0ec08 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:11.119638 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0b56b5a3-89a4-4575-b3b7-f5d3dee0ec08 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:11.120259 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0b56b5a3-89a4-4575-b3b7-f5d3dee0ec08 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:11.120952 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-c51fee82-cfd7-4515-abf0-20c5e051d06c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:11.122722 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-c51fee82-cfd7-4515-abf0-20c5e051d06c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:11.134526 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c51fee82-cfd7-4515-abf0-20c5e051d06c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:11.135307 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c51fee82-cfd7-4515-abf0-20c5e051d06c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:11.137079 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c51fee82-cfd7-4515-abf0-20c5e051d06c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:11.137412 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c51fee82-cfd7-4515-abf0-20c5e051d06c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:11.219264 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-0b56b5a3-89a4-4575-b3b7-f5d3dee0ec08 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] HTTP exception thrown: Instance 060e1452-5aba-4323-894d-a04d6aed8785 is not attached to volume 1b804850-37bf-465e-88ad-c55c312ceee1 Jan 28 00:58:11.219826 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0b56b5a3-89a4-4575-b3b7-f5d3dee0ec08 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Returning 404 to user: Instance 060e1452-5aba-4323-894d-a04d6aed8785 is not attached to volume 1b804850-37bf-465e-88ad-c55c312ceee1 {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:58:11.220794 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0b56b5a3-89a4-4575-b3b7-f5d3dee0ec08 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "DELETE /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785/os-volume_attachments/1b804850-37bf-465e-88ad-c55c312ceee1" status: 404 len: 154 microversion: 2.1 time: 0.117717 Jan 28 00:58:11.221312 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 413/848] 10.222.0.25 () {58 vars in 1415 bytes} [Fri Jan 28 00:58:11 2022] DELETE /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785/os-volume_attachments/1b804850-37bf-465e-88ad-c55c312ceee1 => generated 154 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:58:11.288699 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-c51fee82-cfd7-4515-abf0-20c5e051d06c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 35361 microversion: 2.20 time: 0.172756 Jan 28 00:58:11.289879 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 436/849] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:11 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 35361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 00:58:11.524864 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a218034c-7ae1-4dd1-a41c-0430637a7c0a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:11.525783 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a218034c-7ae1-4dd1-a41c-0430637a7c0a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:11.532919 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a218034c-7ae1-4dd1-a41c-0430637a7c0a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:11.533569 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a218034c-7ae1-4dd1-a41c-0430637a7c0a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:11.534782 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a218034c-7ae1-4dd1-a41c-0430637a7c0a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:11.535481 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a218034c-7ae1-4dd1-a41c-0430637a7c0a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:11.713757 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a218034c-7ae1-4dd1-a41c-0430637a7c0a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:11.725883 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a218034c-7ae1-4dd1-a41c-0430637a7c0a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 200 len: 1363 microversion: 2.1 time: 0.206237 Jan 28 00:58:11.726603 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 414/850] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:11 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:12.305171 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-dd51a588-83ac-4d5f-8e67-bb972b57b4c3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:12.306297 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-dd51a588-83ac-4d5f-8e67-bb972b57b4c3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:12.316424 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-dd51a588-83ac-4d5f-8e67-bb972b57b4c3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:12.316893 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-dd51a588-83ac-4d5f-8e67-bb972b57b4c3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:12.317712 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-dd51a588-83ac-4d5f-8e67-bb972b57b4c3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:12.322571 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-dd51a588-83ac-4d5f-8e67-bb972b57b4c3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:12.430299 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-cf9d8671-83dc-4730-abb8-dea0cceea9b0 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:12.431068 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-cf9d8671-83dc-4730-abb8-dea0cceea9b0 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:12.443368 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cf9d8671-83dc-4730-abb8-dea0cceea9b0 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:12.444075 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cf9d8671-83dc-4730-abb8-dea0cceea9b0 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:12.445444 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cf9d8671-83dc-4730-abb8-dea0cceea9b0 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:12.446259 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cf9d8671-83dc-4730-abb8-dea0cceea9b0 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:12.483312 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-dd51a588-83ac-4d5f-8e67-bb972b57b4c3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 36266 microversion: 2.20 time: 0.183973 Jan 28 00:58:12.488110 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 437/851] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:12 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 36266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:12.488288 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-cf9d8671-83dc-4730-abb8-dea0cceea9b0 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Going to try to terminate instance {{(pid=127863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 00:58:12.594955 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-cf9d8671-83dc-4730-abb8-dea0cceea9b0 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "DELETE /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 204 len: 0 microversion: 2.1 time: 0.167432 Jan 28 00:58:12.596607 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 415/852] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 00:58:12 2022] DELETE /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 00:58:12.606488 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-76ca744e-2b95-406f-b13a-88361556991c tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:12.607350 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-76ca744e-2b95-406f-b13a-88361556991c tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:12.617878 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-76ca744e-2b95-406f-b13a-88361556991c tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:12.618616 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-76ca744e-2b95-406f-b13a-88361556991c tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:12.620208 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-76ca744e-2b95-406f-b13a-88361556991c tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:12.621482 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-76ca744e-2b95-406f-b13a-88361556991c tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:12.745667 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-94c2d3bf-bc6c-4b02-9a87-2bf7751f3698 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:12.746376 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-94c2d3bf-bc6c-4b02-9a87-2bf7751f3698 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:12.754491 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-94c2d3bf-bc6c-4b02-9a87-2bf7751f3698 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:12.754957 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-94c2d3bf-bc6c-4b02-9a87-2bf7751f3698 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:12.755809 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-94c2d3bf-bc6c-4b02-9a87-2bf7751f3698 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:12.756253 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-94c2d3bf-bc6c-4b02-9a87-2bf7751f3698 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:12.789393 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-76ca744e-2b95-406f-b13a-88361556991c tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:12.799301 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-76ca744e-2b95-406f-b13a-88361556991c tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1554 microversion: 2.1 time: 0.196827 Jan 28 00:58:12.800017 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 438/853] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:12 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1554 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:12.929755 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-94c2d3bf-bc6c-4b02-9a87-2bf7751f3698 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:12.940183 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-94c2d3bf-bc6c-4b02-9a87-2bf7751f3698 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 200 len: 1363 microversion: 2.1 time: 0.199061 Jan 28 00:58:12.940832 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 416/854] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:12 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:13.495981 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-217bf651-9ce6-4caa-a0a9-5cfdbcb58946 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:13.496975 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-217bf651-9ce6-4caa-a0a9-5cfdbcb58946 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:13.504086 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-217bf651-9ce6-4caa-a0a9-5cfdbcb58946 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:13.504551 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-217bf651-9ce6-4caa-a0a9-5cfdbcb58946 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:13.505351 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-217bf651-9ce6-4caa-a0a9-5cfdbcb58946 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:13.505844 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-217bf651-9ce6-4caa-a0a9-5cfdbcb58946 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:13.648926 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-217bf651-9ce6-4caa-a0a9-5cfdbcb58946 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 36936 microversion: 2.20 time: 0.156033 Jan 28 00:58:13.650124 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 439/855] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:13 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 36936 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:13.818485 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2e54c18d-8f33-4584-8cef-b609261a4cae tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:13.819294 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2e54c18d-8f33-4584-8cef-b609261a4cae tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:13.827148 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2e54c18d-8f33-4584-8cef-b609261a4cae tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:13.827657 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2e54c18d-8f33-4584-8cef-b609261a4cae tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:13.828965 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2e54c18d-8f33-4584-8cef-b609261a4cae tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:13.828965 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2e54c18d-8f33-4584-8cef-b609261a4cae tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:13.962908 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-bfc26dcb-a468-495a-9183-4f6b72610cc4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:13.964920 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-bfc26dcb-a468-495a-9183-4f6b72610cc4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:13.977969 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bfc26dcb-a468-495a-9183-4f6b72610cc4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:13.978908 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bfc26dcb-a468-495a-9183-4f6b72610cc4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:13.981195 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bfc26dcb-a468-495a-9183-4f6b72610cc4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:13.982163 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-bfc26dcb-a468-495a-9183-4f6b72610cc4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:14.003115 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-2e54c18d-8f33-4584-8cef-b609261a4cae tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:14.011615 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2e54c18d-8f33-4584-8cef-b609261a4cae tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1554 microversion: 2.1 time: 0.197070 Jan 28 00:58:14.012220 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 417/856] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:13 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1554 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:14.178532 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-bfc26dcb-a468-495a-9183-4f6b72610cc4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:14.188668 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-bfc26dcb-a468-495a-9183-4f6b72610cc4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 200 len: 1363 microversion: 2.1 time: 0.233406 Jan 28 00:58:14.189258 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 440/857] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:13 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:14.663806 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-44028c0b-47cf-438d-87eb-85b46deb8f44 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:14.664820 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-44028c0b-47cf-438d-87eb-85b46deb8f44 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:14.672478 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-44028c0b-47cf-438d-87eb-85b46deb8f44 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:14.673138 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-44028c0b-47cf-438d-87eb-85b46deb8f44 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:14.674153 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-44028c0b-47cf-438d-87eb-85b46deb8f44 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:14.675036 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-44028c0b-47cf-438d-87eb-85b46deb8f44 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:14.821337 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-44028c0b-47cf-438d-87eb-85b46deb8f44 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 37669 microversion: 2.20 time: 0.161014 Jan 28 00:58:14.822121 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 418/858] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:14 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 37669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:15.030807 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3329f4e2-344a-4255-a789-d489a811eb05 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:15.031508 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3329f4e2-344a-4255-a789-d489a811eb05 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:15.039038 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3329f4e2-344a-4255-a789-d489a811eb05 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:15.039560 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3329f4e2-344a-4255-a789-d489a811eb05 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:15.040474 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3329f4e2-344a-4255-a789-d489a811eb05 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:15.040941 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3329f4e2-344a-4255-a789-d489a811eb05 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:15.197777 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3329f4e2-344a-4255-a789-d489a811eb05 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:15.206381 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3329f4e2-344a-4255-a789-d489a811eb05 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1554 microversion: 2.1 time: 0.180125 Jan 28 00:58:15.206967 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 441/859] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:15 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:15.211264 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-af8002e6-ebfa-41ce-8786-c16b68b5f5e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:15.211987 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-af8002e6-ebfa-41ce-8786-c16b68b5f5e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:15.219201 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-af8002e6-ebfa-41ce-8786-c16b68b5f5e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:15.219684 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-af8002e6-ebfa-41ce-8786-c16b68b5f5e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:15.220473 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-af8002e6-ebfa-41ce-8786-c16b68b5f5e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:15.220911 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-af8002e6-ebfa-41ce-8786-c16b68b5f5e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:15.389654 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-af8002e6-ebfa-41ce-8786-c16b68b5f5e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:15.398356 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-af8002e6-ebfa-41ce-8786-c16b68b5f5e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 200 len: 1363 microversion: 2.1 time: 0.191246 Jan 28 00:58:15.399066 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 419/860] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:15 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:15.835013 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-81af7aea-c4a2-4251-87a6-7f4fcb307f37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:15.836243 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-81af7aea-c4a2-4251-87a6-7f4fcb307f37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:15.843048 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-81af7aea-c4a2-4251-87a6-7f4fcb307f37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:15.843648 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-81af7aea-c4a2-4251-87a6-7f4fcb307f37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:15.844535 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-81af7aea-c4a2-4251-87a6-7f4fcb307f37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:15.844997 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-81af7aea-c4a2-4251-87a6-7f4fcb307f37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:15.990581 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-81af7aea-c4a2-4251-87a6-7f4fcb307f37 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 38220 microversion: 2.20 time: 0.159578 Jan 28 00:58:15.991860 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 442/861] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:15 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 38220 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:16.154999 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-4787a13d-bff3-4d6e-9890-71b5ab02b36c req-8ae5cece-c47b-48eb-a04d-fb7232815267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64723bd1-f578-4d8a-b562-971874536f1d", "name": "network-vif-plugged", "status": "completed", "tag": "8839566b-538e-4d4a-b002-3de919d10b4d"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:16.162066 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:58:16.162066 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:58:16.181246 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-4787a13d-bff3-4d6e-9890-71b5ab02b36c req-8ae5cece-c47b-48eb-a04d-fb7232815267 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:16.182541 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-4787a13d-bff3-4d6e-9890-71b5ab02b36c req-8ae5cece-c47b-48eb-a04d-fb7232815267 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:16.215618 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-4787a13d-bff3-4d6e-9890-71b5ab02b36c req-8ae5cece-c47b-48eb-a04d-fb7232815267 service nova] Creating event network-vif-plugged:8839566b-538e-4d4a-b002-3de919d10b4d for instance 64723bd1-f578-4d8a-b562-971874536f1d on hv-cinder-80952 Jan 28 00:58:16.218433 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-cf228f8e-eef6-4235-a9cf-e5d2fd1e23ff req-d6019bc5-7efe-46f2-9abd-cc159a240398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "060e1452-5aba-4323-894d-a04d6aed8785", "name": "network-vif-deleted", "tag": "1f359392-df9f-424a-b687-8308d8dcbece"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:16.221864 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:58:16.221864 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:58:16.223554 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-4787a13d-bff3-4d6e-9890-71b5ab02b36c req-8ae5cece-c47b-48eb-a04d-fb7232815267 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094413 Jan 28 00:58:16.225192 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 420/862] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:58:16.233914 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-674f1ea1-df43-48ec-bd2f-532113afe0f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:16.234952 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-674f1ea1-df43-48ec-bd2f-532113afe0f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:16.246291 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-674f1ea1-df43-48ec-bd2f-532113afe0f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:16.247223 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-674f1ea1-df43-48ec-bd2f-532113afe0f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:16.248814 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-674f1ea1-df43-48ec-bd2f-532113afe0f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:16.249515 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-674f1ea1-df43-48ec-bd2f-532113afe0f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:16.252127 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-cf228f8e-eef6-4235-a9cf-e5d2fd1e23ff req-d6019bc5-7efe-46f2-9abd-cc159a240398 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:16.253123 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-cf228f8e-eef6-4235-a9cf-e5d2fd1e23ff req-d6019bc5-7efe-46f2-9abd-cc159a240398 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:16.268111 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-cf228f8e-eef6-4235-a9cf-e5d2fd1e23ff req-d6019bc5-7efe-46f2-9abd-cc159a240398 service nova] Creating event network-vif-deleted:1f359392-df9f-424a-b687-8308d8dcbece for instance 060e1452-5aba-4323-894d-a04d6aed8785 on hv-cinder-80952 Jan 28 00:58:16.275898 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-cf228f8e-eef6-4235-a9cf-e5d2fd1e23ff req-d6019bc5-7efe-46f2-9abd-cc159a240398 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062631 Jan 28 00:58:16.276909 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 443/863] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:58:16.338296 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-674f1ea1-df43-48ec-bd2f-532113afe0f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:16.352377 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-674f1ea1-df43-48ec-bd2f-532113afe0f3 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1512 microversion: 2.1 time: 0.125549 Jan 28 00:58:16.352953 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 421/864] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:16 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1512 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:16.424045 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-134c807c-3639-400b-95a5-fb827cbedd35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:16.425603 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-134c807c-3639-400b-95a5-fb827cbedd35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:16.441967 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-134c807c-3639-400b-95a5-fb827cbedd35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:16.442877 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-134c807c-3639-400b-95a5-fb827cbedd35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:16.444175 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-134c807c-3639-400b-95a5-fb827cbedd35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:16.445207 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-134c807c-3639-400b-95a5-fb827cbedd35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:16.670267 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-134c807c-3639-400b-95a5-fb827cbedd35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:16.679087 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-134c807c-3639-400b-95a5-fb827cbedd35 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 200 len: 1363 microversion: 2.1 time: 0.264625 Jan 28 00:58:16.689971 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 444/865] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:16 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:17.004628 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c62f3b21-a64b-44bc-8280-0cf188a00abc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:17.005931 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c62f3b21-a64b-44bc-8280-0cf188a00abc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:17.012539 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c62f3b21-a64b-44bc-8280-0cf188a00abc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:17.013636 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c62f3b21-a64b-44bc-8280-0cf188a00abc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:17.014510 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c62f3b21-a64b-44bc-8280-0cf188a00abc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:17.014987 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c62f3b21-a64b-44bc-8280-0cf188a00abc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:17.177663 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c62f3b21-a64b-44bc-8280-0cf188a00abc tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 38353 microversion: 2.20 time: 0.176691 Jan 28 00:58:17.182615 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 422/866] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:16 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 38353 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:17.369423 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-b2678cb4-6db9-44d4-9a17-e210905092d2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:17.370080 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-b2678cb4-6db9-44d4-9a17-e210905092d2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:17.378864 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b2678cb4-6db9-44d4-9a17-e210905092d2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:17.379366 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b2678cb4-6db9-44d4-9a17-e210905092d2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:17.380089 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b2678cb4-6db9-44d4-9a17-e210905092d2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:17.380817 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b2678cb4-6db9-44d4-9a17-e210905092d2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:17.428348 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b2678cb4-6db9-44d4-9a17-e210905092d2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:17.428866 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b2678cb4-6db9-44d4-9a17-e210905092d2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:17.429583 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.objects.instance [None req-b2678cb4-6db9-44d4-9a17-e210905092d2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lazy-loading 'fault' on Instance uuid 060e1452-5aba-4323-894d-a04d6aed8785 {{(pid=127862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:58:17.486428 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-b2678cb4-6db9-44d4-9a17-e210905092d2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc05aaccb634ca3bd0a3549333cd06d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc8dc67a706412e8404052725053540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:17.497192 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-b2678cb4-6db9-44d4-9a17-e210905092d2 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 200 len: 1348 microversion: 2.1 time: 0.131447 Jan 28 00:58:17.498359 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 445/867] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:17 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 1348 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:58:17.702581 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-304c24cf-1792-471c-9d02-7987983b43ff tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:17.703329 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-304c24cf-1792-471c-9d02-7987983b43ff tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:17.714343 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-304c24cf-1792-471c-9d02-7987983b43ff tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:17.714992 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-304c24cf-1792-471c-9d02-7987983b43ff tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:17.717068 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-304c24cf-1792-471c-9d02-7987983b43ff tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:17.717665 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-304c24cf-1792-471c-9d02-7987983b43ff tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:17.882304 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-304c24cf-1792-471c-9d02-7987983b43ff tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:17.890677 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-304c24cf-1792-471c-9d02-7987983b43ff tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 200 len: 1363 microversion: 2.1 time: 0.192440 Jan 28 00:58:17.891386 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 423/868] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:17 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:18.190728 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-78fcc15c-c4b7-4434-9c3b-baedaca9f6e4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:18.192173 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-78fcc15c-c4b7-4434-9c3b-baedaca9f6e4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:18.199681 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-78fcc15c-c4b7-4434-9c3b-baedaca9f6e4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:18.200146 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-78fcc15c-c4b7-4434-9c3b-baedaca9f6e4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:18.202025 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-78fcc15c-c4b7-4434-9c3b-baedaca9f6e4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:18.202714 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-78fcc15c-c4b7-4434-9c3b-baedaca9f6e4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:18.339753 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-78fcc15c-c4b7-4434-9c3b-baedaca9f6e4 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 200 len: 38361 microversion: 2.20 time: 0.152121 Jan 28 00:58:18.341777 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 446/869] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:18 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 38361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:18.351544 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0a20fb0c-caee-4f51-8c9d-428033ba1cd1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:18.352321 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0a20fb0c-caee-4f51-8c9d-428033ba1cd1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:18.359304 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0a20fb0c-caee-4f51-8c9d-428033ba1cd1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:18.359756 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0a20fb0c-caee-4f51-8c9d-428033ba1cd1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:18.360574 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0a20fb0c-caee-4f51-8c9d-428033ba1cd1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:18.361020 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0a20fb0c-caee-4f51-8c9d-428033ba1cd1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:18.397708 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0a20fb0c-caee-4f51-8c9d-428033ba1cd1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/ips" status: 200 len: 152 microversion: 2.20 time: 0.049226 Jan 28 00:58:18.399234 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 424/870] 10.222.0.25 () {60 vars in 1288 bytes} [Fri Jan 28 00:58:18 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/ips => generated 152 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:18.517730 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-b752871e-8b40-4f6e-bd4a-b49ad1156648 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:18.519316 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-b752871e-8b40-4f6e-bd4a-b49ad1156648 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] [instance: 060e1452-5aba-4323-894d-a04d6aed8785] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:18.528441 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b752871e-8b40-4f6e-bd4a-b49ad1156648 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:18.529427 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b752871e-8b40-4f6e-bd4a-b49ad1156648 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:18.538491 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b752871e-8b40-4f6e-bd4a-b49ad1156648 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:18.538491 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b752871e-8b40-4f6e-bd4a-b49ad1156648 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:18.561961 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-b752871e-8b40-4f6e-bd4a-b49ad1156648 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] HTTP exception thrown: Instance 060e1452-5aba-4323-894d-a04d6aed8785 could not be found. Jan 28 00:58:18.563870 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-b752871e-8b40-4f6e-bd4a-b49ad1156648 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Returning 404 to user: Instance 060e1452-5aba-4323-894d-a04d6aed8785 could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:58:18.565698 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-b752871e-8b40-4f6e-bd4a-b49ad1156648 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785" status: 404 len: 111 microversion: 2.1 time: 0.051967 Jan 28 00:58:18.566826 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 447/871] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:18 2022] GET /compute/v2.1/servers/060e1452-5aba-4323-894d-a04d6aed8785 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:58:18.580708 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0a945f9a-226e-4acc-b884-7cbe52d5c830 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] Calling method '.version_select at 0x7fbbc21d5af0>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:18.608556 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0a945f9a-226e-4acc-b884-7cbe52d5c830 tempest-TestMinimumBasicScenario-206236750 tempest-TestMinimumBasicScenario-206236750-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1940911014" status: 202 len: 0 microversion: 2.1 time: 0.037272 Jan 28 00:58:18.609390 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 425/872] 10.222.0.25 () {58 vars in 1271 bytes} [Fri Jan 28 00:58:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1940911014 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:58:18.913189 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-fdbf666b-f737-45f8-8f08-5a27ea23ee2b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:18.913813 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-fdbf666b-f737-45f8-8f08-5a27ea23ee2b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:18.922345 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fdbf666b-f737-45f8-8f08-5a27ea23ee2b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:18.923089 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fdbf666b-f737-45f8-8f08-5a27ea23ee2b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:18.923929 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fdbf666b-f737-45f8-8f08-5a27ea23ee2b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:18.924726 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fdbf666b-f737-45f8-8f08-5a27ea23ee2b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:19.103420 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-fdbf666b-f737-45f8-8f08-5a27ea23ee2b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:19.112731 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-fdbf666b-f737-45f8-8f08-5a27ea23ee2b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 200 len: 1548 microversion: 2.1 time: 0.204138 Jan 28 00:58:19.113424 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 448/873] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:58:18 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 1548 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:58:19.131383 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-9068826a-508e-469e-8484-3b76f2f55299 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:19.131908 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-9068826a-508e-469e-8484-3b76f2f55299 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:19.139460 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9068826a-508e-469e-8484-3b76f2f55299 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:19.140097 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9068826a-508e-469e-8484-3b76f2f55299 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:19.141389 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9068826a-508e-469e-8484-3b76f2f55299 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:19.141890 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9068826a-508e-469e-8484-3b76f2f55299 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:19.229748 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-9068826a-508e-469e-8484-3b76f2f55299 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103506 Jan 28 00:58:19.230597 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 426/874] 10.222.0.25 () {58 vars in 1274 bytes} [Fri Jan 28 00:58:19 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:58:20.674062 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-0c2c81a5-de9b-4604-aa37-d616ab4eecfa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:20.675813 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-0c2c81a5-de9b-4604-aa37-d616ab4eecfa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:20.682472 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-af0cf282-9407-4004-8daf-aafd6a5ac3e8 req-74b3308d-d137-413c-a5c3-9fa84bfa45d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64723bd1-f578-4d8a-b562-971874536f1d", "tag": "8839566b-538e-4d4a-b002-3de919d10b4d"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:20.683709 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0c2c81a5-de9b-4604-aa37-d616ab4eecfa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:20.684185 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:58:20.684185 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:58:20.684465 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0c2c81a5-de9b-4604-aa37-d616ab4eecfa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:20.685355 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0c2c81a5-de9b-4604-aa37-d616ab4eecfa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:20.686044 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0c2c81a5-de9b-4604-aa37-d616ab4eecfa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:20.702563 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-af0cf282-9407-4004-8daf-aafd6a5ac3e8 req-74b3308d-d137-413c-a5c3-9fa84bfa45d7 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:20.703172 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-af0cf282-9407-4004-8daf-aafd6a5ac3e8 req-74b3308d-d137-413c-a5c3-9fa84bfa45d7 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:20.735679 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-af0cf282-9407-4004-8daf-aafd6a5ac3e8 req-74b3308d-d137-413c-a5c3-9fa84bfa45d7 service nova] Creating event network-changed:8839566b-538e-4d4a-b002-3de919d10b4d for instance 64723bd1-f578-4d8a-b562-971874536f1d on hv-cinder-80952 Jan 28 00:58:20.746073 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-af0cf282-9407-4004-8daf-aafd6a5ac3e8 req-74b3308d-d137-413c-a5c3-9fa84bfa45d7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067584 Jan 28 00:58:20.748125 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 427/875] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:58:20.899645 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d2df8465-32f8-4e78-9b29-e3158ecc4e5d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:20.900277 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d2df8465-32f8-4e78-9b29-e3158ecc4e5d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:20.911081 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-0c2c81a5-de9b-4604-aa37-d616ab4eecfa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 14 microversion: 2.1 time: 0.241719 Jan 28 00:58:20.911811 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 449/876] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:20 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 14 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:58:20.918985 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d2df8465-32f8-4e78-9b29-e3158ecc4e5d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:20.920140 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d2df8465-32f8-4e78-9b29-e3158ecc4e5d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:20.920969 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d2df8465-32f8-4e78-9b29-e3158ecc4e5d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:20.928127 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d2df8465-32f8-4e78-9b29-e3158ecc4e5d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:20.958330 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.objects.instance [None req-d2df8465-32f8-4e78-9b29-e3158ecc4e5d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lazy-loading 'flavor' on Instance uuid 449f7a22-44b6-4b73-97ae-5e6103c1f90e {{(pid=127863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:58:21.358909 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d2df8465-32f8-4e78-9b29-e3158ecc4e5d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 202 len: 0 microversion: 2.20 time: 0.463008 Jan 28 00:58:21.363934 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 428/877] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:20 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 28 00:58:21.376874 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-120c80e0-fc11-4ae6-af57-656df2c5237a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:21.378980 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-120c80e0-fc11-4ae6-af57-656df2c5237a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:21.398683 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-120c80e0-fc11-4ae6-af57-656df2c5237a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:21.399573 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-120c80e0-fc11-4ae6-af57-656df2c5237a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:21.401024 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-120c80e0-fc11-4ae6-af57-656df2c5237a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:21.402670 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-120c80e0-fc11-4ae6-af57-656df2c5237a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:21.758083 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-120c80e0-fc11-4ae6-af57-656df2c5237a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:21.785820 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-120c80e0-fc11-4ae6-af57-656df2c5237a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:21.796271 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-120c80e0-fc11-4ae6-af57-656df2c5237a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:21.799621 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-120c80e0-fc11-4ae6-af57-656df2c5237a tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1724 microversion: 2.20 time: 0.430981 Jan 28 00:58:21.801390 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 450/878] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:21 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1724 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:21.927945 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-10c558eb-d17b-48b2-bf0b-1250a97dd45d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:21.928977 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-10c558eb-d17b-48b2-bf0b-1250a97dd45d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:21.936851 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-10c558eb-d17b-48b2-bf0b-1250a97dd45d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:21.937130 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-10c558eb-d17b-48b2-bf0b-1250a97dd45d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:21.938432 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-10c558eb-d17b-48b2-bf0b-1250a97dd45d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:21.938958 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-10c558eb-d17b-48b2-bf0b-1250a97dd45d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:22.072499 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-10c558eb-d17b-48b2-bf0b-1250a97dd45d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 14 microversion: 2.1 time: 0.151688 Jan 28 00:58:22.080482 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 429/879] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:21 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:58:22.824216 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-a5237244-59ec-4b32-92eb-3850f0f70e63 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:22.827979 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-a5237244-59ec-4b32-92eb-3850f0f70e63 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:22.836814 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a5237244-59ec-4b32-92eb-3850f0f70e63 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:22.837544 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a5237244-59ec-4b32-92eb-3850f0f70e63 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:22.838563 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a5237244-59ec-4b32-92eb-3850f0f70e63 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:22.839483 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a5237244-59ec-4b32-92eb-3850f0f70e63 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:23.023378 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-a5237244-59ec-4b32-92eb-3850f0f70e63 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:23.032722 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-a5237244-59ec-4b32-92eb-3850f0f70e63 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:23.034343 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-a5237244-59ec-4b32-92eb-3850f0f70e63 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:23.036083 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-a5237244-59ec-4b32-92eb-3850f0f70e63 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1724 microversion: 2.20 time: 0.219464 Jan 28 00:58:23.037408 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 451/880] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:22 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:23.093576 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5a18cd5b-e4ae-4c3b-b9a9-8e2a8cfd43fb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:23.095323 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5a18cd5b-e4ae-4c3b-b9a9-8e2a8cfd43fb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:23.108054 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5a18cd5b-e4ae-4c3b-b9a9-8e2a8cfd43fb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:23.109309 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5a18cd5b-e4ae-4c3b-b9a9-8e2a8cfd43fb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:23.111024 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5a18cd5b-e4ae-4c3b-b9a9-8e2a8cfd43fb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:23.112133 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5a18cd5b-e4ae-4c3b-b9a9-8e2a8cfd43fb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:23.237380 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5a18cd5b-e4ae-4c3b-b9a9-8e2a8cfd43fb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 14 microversion: 2.1 time: 0.151304 Jan 28 00:58:23.240524 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 430/881] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:23 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:58:24.072522 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-a87ae61a-6fbf-4eca-b603-cf846e83d2d6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:24.078270 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-a87ae61a-6fbf-4eca-b603-cf846e83d2d6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:24.096350 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a87ae61a-6fbf-4eca-b603-cf846e83d2d6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:24.096536 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a87ae61a-6fbf-4eca-b603-cf846e83d2d6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:24.097381 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a87ae61a-6fbf-4eca-b603-cf846e83d2d6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:24.100656 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a87ae61a-6fbf-4eca-b603-cf846e83d2d6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:24.250453 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5f172ae6-c7a2-43e7-84ad-58326d791104 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:24.251519 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5f172ae6-c7a2-43e7-84ad-58326d791104 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:24.261887 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5f172ae6-c7a2-43e7-84ad-58326d791104 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:24.262347 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5f172ae6-c7a2-43e7-84ad-58326d791104 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:24.263768 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5f172ae6-c7a2-43e7-84ad-58326d791104 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:24.264210 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5f172ae6-c7a2-43e7-84ad-58326d791104 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:24.401497 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5f172ae6-c7a2-43e7-84ad-58326d791104 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 14 microversion: 2.1 time: 0.155995 Jan 28 00:58:24.402229 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 431/882] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:24 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 00:58:24.437448 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-a87ae61a-6fbf-4eca-b603-cf846e83d2d6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:24.446529 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-a87ae61a-6fbf-4eca-b603-cf846e83d2d6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:24.448418 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-a87ae61a-6fbf-4eca-b603-cf846e83d2d6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:24.451124 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-a87ae61a-6fbf-4eca-b603-cf846e83d2d6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1724 microversion: 2.20 time: 0.387846 Jan 28 00:58:24.452115 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 452/883] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:24 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1724 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:25.415932 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0fcff15f-5c6b-4409-9569-c4019e2340ef tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:25.417952 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0fcff15f-5c6b-4409-9569-c4019e2340ef tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:25.426803 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0fcff15f-5c6b-4409-9569-c4019e2340ef tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:25.427258 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0fcff15f-5c6b-4409-9569-c4019e2340ef tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:25.428330 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0fcff15f-5c6b-4409-9569-c4019e2340ef tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:25.428880 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0fcff15f-5c6b-4409-9569-c4019e2340ef tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:25.473935 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-fa6fa65e-6aa9-46c4-8c77-8fa3c991a46e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:25.475502 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-fa6fa65e-6aa9-46c4-8c77-8fa3c991a46e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:25.482928 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fa6fa65e-6aa9-46c4-8c77-8fa3c991a46e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:25.483419 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fa6fa65e-6aa9-46c4-8c77-8fa3c991a46e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:25.484490 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fa6fa65e-6aa9-46c4-8c77-8fa3c991a46e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:25.485307 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fa6fa65e-6aa9-46c4-8c77-8fa3c991a46e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:25.549613 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0fcff15f-5c6b-4409-9569-c4019e2340ef tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 14 microversion: 2.1 time: 0.137707 Jan 28 00:58:25.552707 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 432/884] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:25 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:58:25.665107 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-fa6fa65e-6aa9-46c4-8c77-8fa3c991a46e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:25.674776 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-fa6fa65e-6aa9-46c4-8c77-8fa3c991a46e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:25.676330 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-fa6fa65e-6aa9-46c4-8c77-8fa3c991a46e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:25.677745 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-fa6fa65e-6aa9-46c4-8c77-8fa3c991a46e tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1724 microversion: 2.20 time: 0.209196 Jan 28 00:58:25.678470 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 453/885] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:25 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:26.561805 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5d238d1b-92fc-44a0-86d2-bac4b5877c57 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:26.563244 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5d238d1b-92fc-44a0-86d2-bac4b5877c57 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:26.570186 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5d238d1b-92fc-44a0-86d2-bac4b5877c57 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:26.570797 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5d238d1b-92fc-44a0-86d2-bac4b5877c57 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:26.571785 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5d238d1b-92fc-44a0-86d2-bac4b5877c57 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:26.572756 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5d238d1b-92fc-44a0-86d2-bac4b5877c57 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:26.699082 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5d238d1b-92fc-44a0-86d2-bac4b5877c57 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 14 microversion: 2.1 time: 0.141627 Jan 28 00:58:26.703355 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-969c0fa3-745c-48f7-a1bc-36fd8e7ae7d2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:26.705409 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-969c0fa3-745c-48f7-a1bc-36fd8e7ae7d2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:26.706433 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 433/886] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:26 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:58:26.717335 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-969c0fa3-745c-48f7-a1bc-36fd8e7ae7d2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:26.718142 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-969c0fa3-745c-48f7-a1bc-36fd8e7ae7d2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:26.719624 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-969c0fa3-745c-48f7-a1bc-36fd8e7ae7d2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:26.720401 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-969c0fa3-745c-48f7-a1bc-36fd8e7ae7d2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:26.904159 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-969c0fa3-745c-48f7-a1bc-36fd8e7ae7d2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:26.924089 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-969c0fa3-745c-48f7-a1bc-36fd8e7ae7d2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:26.925832 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-969c0fa3-745c-48f7-a1bc-36fd8e7ae7d2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:26.927336 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-969c0fa3-745c-48f7-a1bc-36fd8e7ae7d2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1724 microversion: 2.20 time: 0.232148 Jan 28 00:58:26.928450 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 454/887] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:26 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:27.714603 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4c201cbd-e6ba-4d4c-be1c-aa8e02b91a33 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:27.716777 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4c201cbd-e6ba-4d4c-be1c-aa8e02b91a33 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:27.725223 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4c201cbd-e6ba-4d4c-be1c-aa8e02b91a33 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:27.725855 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4c201cbd-e6ba-4d4c-be1c-aa8e02b91a33 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:27.726658 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4c201cbd-e6ba-4d4c-be1c-aa8e02b91a33 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:27.727334 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4c201cbd-e6ba-4d4c-be1c-aa8e02b91a33 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:27.830119 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4c201cbd-e6ba-4d4c-be1c-aa8e02b91a33 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 14 microversion: 2.1 time: 0.119922 Jan 28 00:58:27.833253 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 434/888] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:27 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:58:27.952500 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f7059f8a-4665-4e4d-9c15-edaf537b4fda tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:27.953123 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f7059f8a-4665-4e4d-9c15-edaf537b4fda tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:27.965553 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f7059f8a-4665-4e4d-9c15-edaf537b4fda tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:27.966701 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f7059f8a-4665-4e4d-9c15-edaf537b4fda tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:27.967903 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f7059f8a-4665-4e4d-9c15-edaf537b4fda tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:27.968504 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f7059f8a-4665-4e4d-9c15-edaf537b4fda tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:28.298367 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f7059f8a-4665-4e4d-9c15-edaf537b4fda tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:28.308791 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f7059f8a-4665-4e4d-9c15-edaf537b4fda tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:28.311252 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f7059f8a-4665-4e4d-9c15-edaf537b4fda tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:28.313259 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f7059f8a-4665-4e4d-9c15-edaf537b4fda tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1724 microversion: 2.20 time: 0.365913 Jan 28 00:58:28.325074 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 455/889] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:27 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1724 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:28.843076 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-45865257-77f8-4129-bd62-ccd49a8fc535 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:28.844146 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-45865257-77f8-4129-bd62-ccd49a8fc535 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:28.852188 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-45865257-77f8-4129-bd62-ccd49a8fc535 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:28.853153 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-45865257-77f8-4129-bd62-ccd49a8fc535 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:28.854133 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-45865257-77f8-4129-bd62-ccd49a8fc535 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:28.854667 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-45865257-77f8-4129-bd62-ccd49a8fc535 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:28.971915 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-45865257-77f8-4129-bd62-ccd49a8fc535 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 14 microversion: 2.1 time: 0.133759 Jan 28 00:58:28.973118 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 435/890] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:28 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:58:29.333065 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f3d0b0f2-b510-4c13-b4b1-54efe1137e88 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:29.333775 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f3d0b0f2-b510-4c13-b4b1-54efe1137e88 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:29.342227 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f3d0b0f2-b510-4c13-b4b1-54efe1137e88 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:29.342955 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f3d0b0f2-b510-4c13-b4b1-54efe1137e88 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:29.343992 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f3d0b0f2-b510-4c13-b4b1-54efe1137e88 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:29.344715 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f3d0b0f2-b510-4c13-b4b1-54efe1137e88 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:29.522105 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f3d0b0f2-b510-4c13-b4b1-54efe1137e88 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:29.538898 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f3d0b0f2-b510-4c13-b4b1-54efe1137e88 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:29.542116 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f3d0b0f2-b510-4c13-b4b1-54efe1137e88 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:29.545563 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f3d0b0f2-b510-4c13-b4b1-54efe1137e88 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1724 microversion: 2.20 time: 0.215804 Jan 28 00:58:29.557470 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 456/891] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:29 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:29.985977 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d76ad998-04b2-4cd6-a28c-8b2890017723 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:29.987905 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d76ad998-04b2-4cd6-a28c-8b2890017723 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:29.999136 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d76ad998-04b2-4cd6-a28c-8b2890017723 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:29.999819 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d76ad998-04b2-4cd6-a28c-8b2890017723 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:30.001025 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d76ad998-04b2-4cd6-a28c-8b2890017723 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:30.001679 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d76ad998-04b2-4cd6-a28c-8b2890017723 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:30.367845 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d76ad998-04b2-4cd6-a28c-8b2890017723 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 14 microversion: 2.1 time: 0.387942 Jan 28 00:58:30.368486 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 436/892] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:29 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 14 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 00:58:30.564834 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9635a10c-5bf3-4dc2-a09f-48ac847ee862 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:30.565489 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9635a10c-5bf3-4dc2-a09f-48ac847ee862 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:30.572329 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9635a10c-5bf3-4dc2-a09f-48ac847ee862 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:30.572790 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9635a10c-5bf3-4dc2-a09f-48ac847ee862 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:30.573591 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9635a10c-5bf3-4dc2-a09f-48ac847ee862 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:30.574040 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9635a10c-5bf3-4dc2-a09f-48ac847ee862 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:30.714334 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9635a10c-5bf3-4dc2-a09f-48ac847ee862 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:30.723344 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9635a10c-5bf3-4dc2-a09f-48ac847ee862 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:30.724847 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9635a10c-5bf3-4dc2-a09f-48ac847ee862 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:30.726026 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9635a10c-5bf3-4dc2-a09f-48ac847ee862 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1724 microversion: 2.20 time: 0.165086 Jan 28 00:58:30.726589 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 457/893] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:30 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:58:31.381506 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e922b8d2-bad3-4ac9-86cf-c68fffd5a637 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:31.381506 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e922b8d2-bad3-4ac9-86cf-c68fffd5a637 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:31.389582 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e922b8d2-bad3-4ac9-86cf-c68fffd5a637 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:31.390027 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e922b8d2-bad3-4ac9-86cf-c68fffd5a637 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:31.391401 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e922b8d2-bad3-4ac9-86cf-c68fffd5a637 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:31.391979 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e922b8d2-bad3-4ac9-86cf-c68fffd5a637 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:31.511826 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e922b8d2-bad3-4ac9-86cf-c68fffd5a637 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 14 microversion: 2.1 time: 0.136068 Jan 28 00:58:31.512666 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 437/894] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:31 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 00:58:31.745749 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-94a520e0-2432-4bd5-9c82-daa62a9d720d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:31.746397 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-94a520e0-2432-4bd5-9c82-daa62a9d720d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:31.754335 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-94a520e0-2432-4bd5-9c82-daa62a9d720d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:31.754802 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-94a520e0-2432-4bd5-9c82-daa62a9d720d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:31.755639 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-94a520e0-2432-4bd5-9c82-daa62a9d720d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:31.756088 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-94a520e0-2432-4bd5-9c82-daa62a9d720d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:31.904111 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-94a520e0-2432-4bd5-9c82-daa62a9d720d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:31.922481 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-94a520e0-2432-4bd5-9c82-daa62a9d720d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:31.925008 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-94a520e0-2432-4bd5-9c82-daa62a9d720d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:31.926898 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-94a520e0-2432-4bd5-9c82-daa62a9d720d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1724 microversion: 2.20 time: 0.184469 Jan 28 00:58:31.927486 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 458/895] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:31 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:32.525392 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c4e340d0-8f54-4daa-9c88-9aec63052ce0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:32.526405 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c4e340d0-8f54-4daa-9c88-9aec63052ce0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:32.534251 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c4e340d0-8f54-4daa-9c88-9aec63052ce0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:32.534713 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c4e340d0-8f54-4daa-9c88-9aec63052ce0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:32.535559 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c4e340d0-8f54-4daa-9c88-9aec63052ce0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:32.536005 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c4e340d0-8f54-4daa-9c88-9aec63052ce0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:32.639395 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c4e340d0-8f54-4daa-9c88-9aec63052ce0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 14 microversion: 2.1 time: 0.117664 Jan 28 00:58:32.641672 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 438/896] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:32 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:58:32.952412 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4c8c8cbf-62c8-4ce0-84ee-b6808c1a4a97 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:32.953164 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4c8c8cbf-62c8-4ce0-84ee-b6808c1a4a97 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:32.960812 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c8c8cbf-62c8-4ce0-84ee-b6808c1a4a97 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:32.961577 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c8c8cbf-62c8-4ce0-84ee-b6808c1a4a97 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:32.962994 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c8c8cbf-62c8-4ce0-84ee-b6808c1a4a97 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:32.963831 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4c8c8cbf-62c8-4ce0-84ee-b6808c1a4a97 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:33.160662 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4c8c8cbf-62c8-4ce0-84ee-b6808c1a4a97 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:33.171747 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4c8c8cbf-62c8-4ce0-84ee-b6808c1a4a97 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:33.174532 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4c8c8cbf-62c8-4ce0-84ee-b6808c1a4a97 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:33.176742 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4c8c8cbf-62c8-4ce0-84ee-b6808c1a4a97 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1724 microversion: 2.20 time: 0.230597 Jan 28 00:58:33.177767 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 459/897] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:32 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:33.652536 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f646a813-e2d7-4114-ac1d-55d307e107b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:33.653958 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f646a813-e2d7-4114-ac1d-55d307e107b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:33.665155 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f646a813-e2d7-4114-ac1d-55d307e107b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:33.665907 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f646a813-e2d7-4114-ac1d-55d307e107b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:33.667252 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f646a813-e2d7-4114-ac1d-55d307e107b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:33.668070 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f646a813-e2d7-4114-ac1d-55d307e107b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:33.779873 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f646a813-e2d7-4114-ac1d-55d307e107b4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 14 microversion: 2.1 time: 0.130572 Jan 28 00:58:33.781014 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 439/898] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:33 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 00:58:34.203142 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ea9da178-4c9f-4c18-937a-42b3b27431ec tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:34.203839 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ea9da178-4c9f-4c18-937a-42b3b27431ec tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:34.210343 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ea9da178-4c9f-4c18-937a-42b3b27431ec tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:34.210805 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ea9da178-4c9f-4c18-937a-42b3b27431ec tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:34.211635 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ea9da178-4c9f-4c18-937a-42b3b27431ec tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:34.212084 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ea9da178-4c9f-4c18-937a-42b3b27431ec tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:34.386899 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ea9da178-4c9f-4c18-937a-42b3b27431ec tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:34.397231 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ea9da178-4c9f-4c18-937a-42b3b27431ec tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:34.399109 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ea9da178-4c9f-4c18-937a-42b3b27431ec tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:34.400624 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ea9da178-4c9f-4c18-937a-42b3b27431ec tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1724 microversion: 2.20 time: 0.204090 Jan 28 00:58:34.401550 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 460/899] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:34 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:34.791912 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-026d2287-72c4-4bca-bd02-68a3717eb4f6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:34.792919 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-026d2287-72c4-4bca-bd02-68a3717eb4f6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:34.800165 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-026d2287-72c4-4bca-bd02-68a3717eb4f6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:34.800619 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-026d2287-72c4-4bca-bd02-68a3717eb4f6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:34.810115 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-026d2287-72c4-4bca-bd02-68a3717eb4f6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:34.810115 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-026d2287-72c4-4bca-bd02-68a3717eb4f6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:34.926162 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-026d2287-72c4-4bca-bd02-68a3717eb4f6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 11817 microversion: 2.1 time: 0.138090 Jan 28 00:58:34.926905 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 440/900] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:34 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 11817 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:35.425672 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d161fb03-1202-4857-8882-2be7cbe2693d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:35.426341 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d161fb03-1202-4857-8882-2be7cbe2693d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:35.432760 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d161fb03-1202-4857-8882-2be7cbe2693d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:35.433230 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d161fb03-1202-4857-8882-2be7cbe2693d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:35.434041 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d161fb03-1202-4857-8882-2be7cbe2693d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:35.434486 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d161fb03-1202-4857-8882-2be7cbe2693d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:35.580817 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d161fb03-1202-4857-8882-2be7cbe2693d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:35.588957 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d161fb03-1202-4857-8882-2be7cbe2693d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:35.590523 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d161fb03-1202-4857-8882-2be7cbe2693d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:35.593072 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d161fb03-1202-4857-8882-2be7cbe2693d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1724 microversion: 2.20 time: 0.171190 Jan 28 00:58:35.593655 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 461/901] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:35 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:35.940421 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2212711e-04b4-443e-a928-d8323c557668 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:35.941470 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2212711e-04b4-443e-a928-d8323c557668 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:35.948411 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2212711e-04b4-443e-a928-d8323c557668 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:35.948866 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2212711e-04b4-443e-a928-d8323c557668 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:35.949656 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2212711e-04b4-443e-a928-d8323c557668 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:35.950102 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2212711e-04b4-443e-a928-d8323c557668 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:36.080389 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2212711e-04b4-443e-a928-d8323c557668 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 17808 microversion: 2.1 time: 0.143755 Jan 28 00:58:36.081235 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 441/902] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:35 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 17808 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:36.613589 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-2f316746-0088-4aaf-812b-afa0dc6519f3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:36.614400 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-2f316746-0088-4aaf-812b-afa0dc6519f3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:36.623147 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2f316746-0088-4aaf-812b-afa0dc6519f3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:36.623696 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2f316746-0088-4aaf-812b-afa0dc6519f3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:36.624770 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2f316746-0088-4aaf-812b-afa0dc6519f3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:36.625331 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2f316746-0088-4aaf-812b-afa0dc6519f3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:36.784998 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-2f316746-0088-4aaf-812b-afa0dc6519f3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:36.793419 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-2f316746-0088-4aaf-812b-afa0dc6519f3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:36.795514 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-2f316746-0088-4aaf-812b-afa0dc6519f3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:36.797096 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-2f316746-0088-4aaf-812b-afa0dc6519f3 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1724 microversion: 2.20 time: 0.188498 Jan 28 00:58:36.797711 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 462/903] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:36 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:37.093787 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5f8d5036-adaf-4e8e-8a51-8047e0ec7b43 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:37.094804 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5f8d5036-adaf-4e8e-8a51-8047e0ec7b43 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:37.102023 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5f8d5036-adaf-4e8e-8a51-8047e0ec7b43 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:37.102482 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5f8d5036-adaf-4e8e-8a51-8047e0ec7b43 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:37.103317 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5f8d5036-adaf-4e8e-8a51-8047e0ec7b43 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:37.103773 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5f8d5036-adaf-4e8e-8a51-8047e0ec7b43 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:37.236147 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5f8d5036-adaf-4e8e-8a51-8047e0ec7b43 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 18056 microversion: 2.1 time: 0.147277 Jan 28 00:58:37.236801 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 442/904] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:37 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 18056 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:37.814930 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7877b119-97f4-49f2-a4c1-679396492f21 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:37.815598 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7877b119-97f4-49f2-a4c1-679396492f21 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:37.823640 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7877b119-97f4-49f2-a4c1-679396492f21 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:37.824292 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7877b119-97f4-49f2-a4c1-679396492f21 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:37.825262 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7877b119-97f4-49f2-a4c1-679396492f21 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:37.825931 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7877b119-97f4-49f2-a4c1-679396492f21 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:38.001905 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7877b119-97f4-49f2-a4c1-679396492f21 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:38.010822 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7877b119-97f4-49f2-a4c1-679396492f21 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:38.012435 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7877b119-97f4-49f2-a4c1-679396492f21 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:38.014261 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7877b119-97f4-49f2-a4c1-679396492f21 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1745 microversion: 2.20 time: 0.203123 Jan 28 00:58:38.014838 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 463/905] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:37 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1745 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:38.248342 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ef9cc6a9-9556-420e-900c-29b8eedb9cba tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:38.249717 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ef9cc6a9-9556-420e-900c-29b8eedb9cba tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:38.257755 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ef9cc6a9-9556-420e-900c-29b8eedb9cba tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:38.258294 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ef9cc6a9-9556-420e-900c-29b8eedb9cba tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:38.259417 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ef9cc6a9-9556-420e-900c-29b8eedb9cba tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:38.259986 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ef9cc6a9-9556-420e-900c-29b8eedb9cba tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:38.386257 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ef9cc6a9-9556-420e-900c-29b8eedb9cba tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 19399 microversion: 2.1 time: 0.138245 Jan 28 00:58:38.387176 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 443/906] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:38 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 19399 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:39.038488 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-21db8bda-dc94-49ed-b577-752fb2e01527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:39.039020 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-21db8bda-dc94-49ed-b577-752fb2e01527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:39.046234 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-21db8bda-dc94-49ed-b577-752fb2e01527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:39.046695 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-21db8bda-dc94-49ed-b577-752fb2e01527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:39.047547 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-21db8bda-dc94-49ed-b577-752fb2e01527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:39.047988 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-21db8bda-dc94-49ed-b577-752fb2e01527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:39.206496 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-21db8bda-dc94-49ed-b577-752fb2e01527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:39.215286 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-21db8bda-dc94-49ed-b577-752fb2e01527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:39.217356 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-21db8bda-dc94-49ed-b577-752fb2e01527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:39.218541 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-21db8bda-dc94-49ed-b577-752fb2e01527 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1745 microversion: 2.20 time: 0.184378 Jan 28 00:58:39.219118 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 464/907] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:39 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:39.399911 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-30aac045-b751-4111-a059-c2de9fa3c38b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:39.400973 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-30aac045-b751-4111-a059-c2de9fa3c38b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:39.408489 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-30aac045-b751-4111-a059-c2de9fa3c38b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:39.408948 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-30aac045-b751-4111-a059-c2de9fa3c38b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:39.409764 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-30aac045-b751-4111-a059-c2de9fa3c38b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:39.410213 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-30aac045-b751-4111-a059-c2de9fa3c38b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:39.535941 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-30aac045-b751-4111-a059-c2de9fa3c38b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 21971 microversion: 2.1 time: 0.139979 Jan 28 00:58:39.536667 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 444/908] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:39 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 21971 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:40.238000 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-a4ff3d14-b0bc-4e74-8a4a-aaa69dfae131 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:40.242884 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-a4ff3d14-b0bc-4e74-8a4a-aaa69dfae131 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:40.250763 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a4ff3d14-b0bc-4e74-8a4a-aaa69dfae131 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:40.251694 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a4ff3d14-b0bc-4e74-8a4a-aaa69dfae131 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:40.252758 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a4ff3d14-b0bc-4e74-8a4a-aaa69dfae131 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:40.253421 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a4ff3d14-b0bc-4e74-8a4a-aaa69dfae131 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:40.304260 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-1d93d0f1-1881-4ee8-966c-885c613f4bbc req-aab4fb70-f365-4a2c-b0e0-6a5f3f290205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449f7a22-44b6-4b73-97ae-5e6103c1f90e", "name": "network-vif-plugged", "status": "completed", "tag": "3c8d8372-3e6d-4edb-96a4-9c2255946417"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:40.306245 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:58:40.306245 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:58:40.323163 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-1d93d0f1-1881-4ee8-966c-885c613f4bbc req-aab4fb70-f365-4a2c-b0e0-6a5f3f290205 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:40.324317 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-1d93d0f1-1881-4ee8-966c-885c613f4bbc req-aab4fb70-f365-4a2c-b0e0-6a5f3f290205 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:40.337111 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-1d93d0f1-1881-4ee8-966c-885c613f4bbc req-aab4fb70-f365-4a2c-b0e0-6a5f3f290205 service nova] Creating event network-vif-plugged:3c8d8372-3e6d-4edb-96a4-9c2255946417 for instance 449f7a22-44b6-4b73-97ae-5e6103c1f90e on hv-cinder-80952 Jan 28 00:58:40.343709 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-1d93d0f1-1881-4ee8-966c-885c613f4bbc req-aab4fb70-f365-4a2c-b0e0-6a5f3f290205 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043277 Jan 28 00:58:40.344909 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 445/909] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:58:40.435242 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-a4ff3d14-b0bc-4e74-8a4a-aaa69dfae131 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:40.443749 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-a4ff3d14-b0bc-4e74-8a4a-aaa69dfae131 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:40.445254 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-a4ff3d14-b0bc-4e74-8a4a-aaa69dfae131 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:40.447116 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-a4ff3d14-b0bc-4e74-8a4a-aaa69dfae131 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1740 microversion: 2.20 time: 0.213362 Jan 28 00:58:40.448079 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 465/910] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:40 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:40.551208 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c1157ed7-5597-4f66-b75b-43cd3cff7c36 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:40.552849 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c1157ed7-5597-4f66-b75b-43cd3cff7c36 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:40.559781 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c1157ed7-5597-4f66-b75b-43cd3cff7c36 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:40.560794 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c1157ed7-5597-4f66-b75b-43cd3cff7c36 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:40.562449 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c1157ed7-5597-4f66-b75b-43cd3cff7c36 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:40.563158 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c1157ed7-5597-4f66-b75b-43cd3cff7c36 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:40.669789 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c1157ed7-5597-4f66-b75b-43cd3cff7c36 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 23234 microversion: 2.1 time: 0.122195 Jan 28 00:58:40.671137 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 446/911] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:40 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 23234 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:41.469905 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-868f44dd-4b0e-4d1d-a06e-79059b8066bf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:41.470947 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-868f44dd-4b0e-4d1d-a06e-79059b8066bf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:41.482339 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-868f44dd-4b0e-4d1d-a06e-79059b8066bf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:41.483107 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-868f44dd-4b0e-4d1d-a06e-79059b8066bf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:41.484479 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-868f44dd-4b0e-4d1d-a06e-79059b8066bf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:41.485411 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-868f44dd-4b0e-4d1d-a06e-79059b8066bf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:41.670559 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-868f44dd-4b0e-4d1d-a06e-79059b8066bf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:41.684930 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-868f44dd-4b0e-4d1d-a06e-79059b8066bf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:41.686573 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-868f44dd-4b0e-4d1d-a06e-79059b8066bf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:41.687919 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-868f44dd-4b0e-4d1d-a06e-79059b8066bf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1740 microversion: 2.20 time: 0.224899 Jan 28 00:58:41.688894 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 466/912] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:41 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:41.704036 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-71eb97b4-8894-4a5a-8098-b9bf25a00d34 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:41.705948 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-71eb97b4-8894-4a5a-8098-b9bf25a00d34 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:41.721626 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-71eb97b4-8894-4a5a-8098-b9bf25a00d34 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:41.722755 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-71eb97b4-8894-4a5a-8098-b9bf25a00d34 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:41.724464 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-71eb97b4-8894-4a5a-8098-b9bf25a00d34 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:41.725255 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-71eb97b4-8894-4a5a-8098-b9bf25a00d34 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:41.883640 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-71eb97b4-8894-4a5a-8098-b9bf25a00d34 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 24624 microversion: 2.1 time: 0.202502 Jan 28 00:58:41.884322 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 447/913] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:41 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 24624 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:42.721838 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-422faea8-5c0c-45e3-9a50-75cd05a40627 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:42.723932 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-422faea8-5c0c-45e3-9a50-75cd05a40627 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:42.735520 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-422faea8-5c0c-45e3-9a50-75cd05a40627 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:42.736315 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-422faea8-5c0c-45e3-9a50-75cd05a40627 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:42.738074 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-422faea8-5c0c-45e3-9a50-75cd05a40627 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:42.738860 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-422faea8-5c0c-45e3-9a50-75cd05a40627 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:42.901227 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e4fab2f6-19b0-4bd0-9806-9fc38f7e9100 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:42.902274 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e4fab2f6-19b0-4bd0-9806-9fc38f7e9100 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:42.911469 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e4fab2f6-19b0-4bd0-9806-9fc38f7e9100 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:42.912314 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e4fab2f6-19b0-4bd0-9806-9fc38f7e9100 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:42.913431 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e4fab2f6-19b0-4bd0-9806-9fc38f7e9100 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:42.914124 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e4fab2f6-19b0-4bd0-9806-9fc38f7e9100 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:42.963631 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-422faea8-5c0c-45e3-9a50-75cd05a40627 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:42.976524 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-422faea8-5c0c-45e3-9a50-75cd05a40627 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:42.977691 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-422faea8-5c0c-45e3-9a50-75cd05a40627 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:42.978999 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-422faea8-5c0c-45e3-9a50-75cd05a40627 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1740 microversion: 2.20 time: 0.264405 Jan 28 00:58:42.979622 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 467/914] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:42 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:43.039661 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e4fab2f6-19b0-4bd0-9806-9fc38f7e9100 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 25934 microversion: 2.1 time: 0.144825 Jan 28 00:58:43.041854 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 448/915] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:42 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 25934 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:43.999875 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-a6e4f48c-f9ba-4787-8dc4-cbc10681d3cf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:44.000531 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-a6e4f48c-f9ba-4787-8dc4-cbc10681d3cf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:44.009344 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a6e4f48c-f9ba-4787-8dc4-cbc10681d3cf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:44.009888 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a6e4f48c-f9ba-4787-8dc4-cbc10681d3cf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:44.010707 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a6e4f48c-f9ba-4787-8dc4-cbc10681d3cf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:44.011142 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a6e4f48c-f9ba-4787-8dc4-cbc10681d3cf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:44.060140 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e33557e7-9c07-4f88-aaec-52978492ebd4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:44.065770 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e33557e7-9c07-4f88-aaec-52978492ebd4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:44.084029 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e33557e7-9c07-4f88-aaec-52978492ebd4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:44.085214 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e33557e7-9c07-4f88-aaec-52978492ebd4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:44.088774 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e33557e7-9c07-4f88-aaec-52978492ebd4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:44.089556 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e33557e7-9c07-4f88-aaec-52978492ebd4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:44.208699 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-a6e4f48c-f9ba-4787-8dc4-cbc10681d3cf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:44.224244 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-a6e4f48c-f9ba-4787-8dc4-cbc10681d3cf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:44.224921 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e33557e7-9c07-4f88-aaec-52978492ebd4 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 27046 microversion: 2.1 time: 0.172769 Jan 28 00:58:44.226462 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-a6e4f48c-f9ba-4787-8dc4-cbc10681d3cf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:44.228137 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-a6e4f48c-f9ba-4787-8dc4-cbc10681d3cf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1740 microversion: 2.20 time: 0.233409 Jan 28 00:58:44.229061 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 468/916] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:43 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1740 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:44.229748 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 449/917] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:44 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 27046 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:58:45.241804 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-5fdbdf82-324c-472d-a5d3-9d30727d599b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:45.243807 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-5fdbdf82-324c-472d-a5d3-9d30727d599b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:45.249116 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f69d31db-f810-4e7b-a213-45f98afdc233 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:45.250287 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f69d31db-f810-4e7b-a213-45f98afdc233 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:45.260386 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5fdbdf82-324c-472d-a5d3-9d30727d599b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:45.261757 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5fdbdf82-324c-472d-a5d3-9d30727d599b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:45.265311 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5fdbdf82-324c-472d-a5d3-9d30727d599b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:45.267025 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5fdbdf82-324c-472d-a5d3-9d30727d599b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:45.273503 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f69d31db-f810-4e7b-a213-45f98afdc233 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:45.273992 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f69d31db-f810-4e7b-a213-45f98afdc233 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:45.280794 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f69d31db-f810-4e7b-a213-45f98afdc233 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:45.282690 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f69d31db-f810-4e7b-a213-45f98afdc233 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:45.497295 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-5fdbdf82-324c-472d-a5d3-9d30727d599b tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 27666 microversion: 2.1 time: 0.262676 Jan 28 00:58:45.502267 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 469/918] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:45 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 27666 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:45.519712 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f69d31db-f810-4e7b-a213-45f98afdc233 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:45.531366 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f69d31db-f810-4e7b-a213-45f98afdc233 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:45.533686 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f69d31db-f810-4e7b-a213-45f98afdc233 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:45.535107 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f69d31db-f810-4e7b-a213-45f98afdc233 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1740 microversion: 2.20 time: 0.292265 Jan 28 00:58:45.536026 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 450/919] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:45 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1740 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:58:46.512866 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9f522efc-2043-4652-979f-99077c0c8053 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:46.514137 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9f522efc-2043-4652-979f-99077c0c8053 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:46.522054 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9f522efc-2043-4652-979f-99077c0c8053 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:46.522888 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9f522efc-2043-4652-979f-99077c0c8053 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:46.523847 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9f522efc-2043-4652-979f-99077c0c8053 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:46.524511 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9f522efc-2043-4652-979f-99077c0c8053 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:46.561541 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a7991eb1-6fef-47cb-ae2a-fa3ef7d720dd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:46.568930 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a7991eb1-6fef-47cb-ae2a-fa3ef7d720dd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:46.583443 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a7991eb1-6fef-47cb-ae2a-fa3ef7d720dd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:46.584842 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a7991eb1-6fef-47cb-ae2a-fa3ef7d720dd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:46.586265 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a7991eb1-6fef-47cb-ae2a-fa3ef7d720dd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:46.587116 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a7991eb1-6fef-47cb-ae2a-fa3ef7d720dd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:46.674072 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9f522efc-2043-4652-979f-99077c0c8053 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 27968 microversion: 2.1 time: 0.165007 Jan 28 00:58:46.683319 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 470/920] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:46 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 27968 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:46.889191 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a7991eb1-6fef-47cb-ae2a-fa3ef7d720dd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:46.899914 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a7991eb1-6fef-47cb-ae2a-fa3ef7d720dd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:46.902105 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a7991eb1-6fef-47cb-ae2a-fa3ef7d720dd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:46.903656 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a7991eb1-6fef-47cb-ae2a-fa3ef7d720dd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1740 microversion: 2.20 time: 0.351008 Jan 28 00:58:46.904406 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 451/921] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:46 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1740 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:47.692873 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ebf5ef56-a038-4e73-bbe1-e1b7634bbb63 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:47.694136 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ebf5ef56-a038-4e73-bbe1-e1b7634bbb63 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:47.705525 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ebf5ef56-a038-4e73-bbe1-e1b7634bbb63 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:47.705988 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ebf5ef56-a038-4e73-bbe1-e1b7634bbb63 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:47.706801 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ebf5ef56-a038-4e73-bbe1-e1b7634bbb63 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:47.707248 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ebf5ef56-a038-4e73-bbe1-e1b7634bbb63 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:47.836988 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ebf5ef56-a038-4e73-bbe1-e1b7634bbb63 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 28212 microversion: 2.1 time: 0.149951 Jan 28 00:58:47.837657 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 471/922] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:47 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 28212 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:47.926365 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-183aa7d3-5ed9-47c1-8394-3a6357deb499 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:47.928013 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-183aa7d3-5ed9-47c1-8394-3a6357deb499 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:47.937735 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-183aa7d3-5ed9-47c1-8394-3a6357deb499 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:47.939051 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-183aa7d3-5ed9-47c1-8394-3a6357deb499 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:47.940699 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-183aa7d3-5ed9-47c1-8394-3a6357deb499 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:47.941357 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-183aa7d3-5ed9-47c1-8394-3a6357deb499 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:48.132178 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-183aa7d3-5ed9-47c1-8394-3a6357deb499 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:48.149835 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-183aa7d3-5ed9-47c1-8394-3a6357deb499 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:48.151922 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-183aa7d3-5ed9-47c1-8394-3a6357deb499 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:48.153616 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-183aa7d3-5ed9-47c1-8394-3a6357deb499 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1740 microversion: 2.20 time: 0.234370 Jan 28 00:58:48.160326 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 452/923] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:47 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:48.855860 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-699d7fa4-a80e-45b5-a4ae-770e558e7052 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:48.858871 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-699d7fa4-a80e-45b5-a4ae-770e558e7052 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:48.874088 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-699d7fa4-a80e-45b5-a4ae-770e558e7052 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:48.874567 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-699d7fa4-a80e-45b5-a4ae-770e558e7052 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:48.875594 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-699d7fa4-a80e-45b5-a4ae-770e558e7052 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:48.876104 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-699d7fa4-a80e-45b5-a4ae-770e558e7052 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:48.991334 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-699d7fa4-a80e-45b5-a4ae-770e558e7052 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 28212 microversion: 2.1 time: 0.143151 Jan 28 00:58:48.993537 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 472/924] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:48 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 28212 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:49.182373 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-9434a024-590a-4402-962f-986853b3e877 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:49.183015 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-9434a024-590a-4402-962f-986853b3e877 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:49.191819 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9434a024-590a-4402-962f-986853b3e877 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:49.192283 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9434a024-590a-4402-962f-986853b3e877 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:49.193109 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9434a024-590a-4402-962f-986853b3e877 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:49.193548 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9434a024-590a-4402-962f-986853b3e877 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:49.361430 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-9434a024-590a-4402-962f-986853b3e877 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:49.370087 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-9434a024-590a-4402-962f-986853b3e877 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:49.371708 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-9434a024-590a-4402-962f-986853b3e877 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:49.372960 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-9434a024-590a-4402-962f-986853b3e877 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1740 microversion: 2.20 time: 0.196900 Jan 28 00:58:49.373682 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 453/925] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:49 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:58:50.005368 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ae4e1391-6010-4ff2-bd5d-510b54b162cc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:50.006687 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ae4e1391-6010-4ff2-bd5d-510b54b162cc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:50.014822 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ae4e1391-6010-4ff2-bd5d-510b54b162cc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:50.015628 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ae4e1391-6010-4ff2-bd5d-510b54b162cc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:50.016921 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ae4e1391-6010-4ff2-bd5d-510b54b162cc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:50.017547 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ae4e1391-6010-4ff2-bd5d-510b54b162cc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:50.130043 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ae4e1391-6010-4ff2-bd5d-510b54b162cc tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 28503 microversion: 2.1 time: 0.128506 Jan 28 00:58:50.131068 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 473/926] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:49 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 28503 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:50.393212 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-18bb35f3-a97e-4daa-a8aa-95a07103497f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:50.393774 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-18bb35f3-a97e-4daa-a8aa-95a07103497f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:50.400326 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-18bb35f3-a97e-4daa-a8aa-95a07103497f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:50.400780 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-18bb35f3-a97e-4daa-a8aa-95a07103497f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:50.401607 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-18bb35f3-a97e-4daa-a8aa-95a07103497f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:50.402044 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-18bb35f3-a97e-4daa-a8aa-95a07103497f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:50.549746 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-18bb35f3-a97e-4daa-a8aa-95a07103497f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:50.557968 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-18bb35f3-a97e-4daa-a8aa-95a07103497f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:50.560226 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-18bb35f3-a97e-4daa-a8aa-95a07103497f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:50.561804 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-18bb35f3-a97e-4daa-a8aa-95a07103497f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1740 microversion: 2.20 time: 0.173851 Jan 28 00:58:50.562395 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 454/927] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:50 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:51.144278 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-e7168c17-4a24-42c5-a7f4-d333b10c92ff tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:51.145236 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-e7168c17-4a24-42c5-a7f4-d333b10c92ff tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:51.152440 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e7168c17-4a24-42c5-a7f4-d333b10c92ff tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:51.152904 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e7168c17-4a24-42c5-a7f4-d333b10c92ff tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:51.154424 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e7168c17-4a24-42c5-a7f4-d333b10c92ff tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:51.155117 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e7168c17-4a24-42c5-a7f4-d333b10c92ff tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:51.271714 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-e7168c17-4a24-42c5-a7f4-d333b10c92ff tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 28671 microversion: 2.1 time: 0.132133 Jan 28 00:58:51.272390 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 474/928] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:51 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 28671 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:51.579820 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1a0b0869-2122-4b72-8183-7c58b51955a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:51.580443 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-1a0b0869-2122-4b72-8183-7c58b51955a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:51.586816 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1a0b0869-2122-4b72-8183-7c58b51955a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:51.587292 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1a0b0869-2122-4b72-8183-7c58b51955a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:51.588099 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1a0b0869-2122-4b72-8183-7c58b51955a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:51.588539 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1a0b0869-2122-4b72-8183-7c58b51955a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:51.728644 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-1a0b0869-2122-4b72-8183-7c58b51955a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:51.738512 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-1a0b0869-2122-4b72-8183-7c58b51955a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:51.740094 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-1a0b0869-2122-4b72-8183-7c58b51955a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:51.741245 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1a0b0869-2122-4b72-8183-7c58b51955a8 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1722 microversion: 2.20 time: 0.165265 Jan 28 00:58:51.741803 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 455/929] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:51 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:52.286126 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-29bc63a3-5c76-48c0-8474-621edb718ab6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:52.287147 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-29bc63a3-5c76-48c0-8474-621edb718ab6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:52.294729 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-29bc63a3-5c76-48c0-8474-621edb718ab6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:52.295899 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-29bc63a3-5c76-48c0-8474-621edb718ab6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:52.296935 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-29bc63a3-5c76-48c0-8474-621edb718ab6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:52.297420 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-29bc63a3-5c76-48c0-8474-621edb718ab6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:52.408812 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-29bc63a3-5c76-48c0-8474-621edb718ab6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 28671 microversion: 2.1 time: 0.127480 Jan 28 00:58:52.409482 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 475/930] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:52 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 28671 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:52.759543 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d475c52f-6fff-4d99-a77d-880be2a45e59 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:52.760152 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d475c52f-6fff-4d99-a77d-880be2a45e59 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:52.767132 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d475c52f-6fff-4d99-a77d-880be2a45e59 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:52.767681 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d475c52f-6fff-4d99-a77d-880be2a45e59 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:52.768620 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d475c52f-6fff-4d99-a77d-880be2a45e59 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:52.769099 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d475c52f-6fff-4d99-a77d-880be2a45e59 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:52.900629 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d475c52f-6fff-4d99-a77d-880be2a45e59 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:52.909580 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d475c52f-6fff-4d99-a77d-880be2a45e59 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:52.911122 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d475c52f-6fff-4d99-a77d-880be2a45e59 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:52.912324 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d475c52f-6fff-4d99-a77d-880be2a45e59 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1722 microversion: 2.20 time: 0.156555 Jan 28 00:58:52.912890 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 456/931] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:52 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:53.422236 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-779746e0-c02b-4c02-bdea-e74357aaec6d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:53.423257 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-779746e0-c02b-4c02-bdea-e74357aaec6d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:53.430547 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-779746e0-c02b-4c02-bdea-e74357aaec6d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:53.431006 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-779746e0-c02b-4c02-bdea-e74357aaec6d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:53.431845 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-779746e0-c02b-4c02-bdea-e74357aaec6d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:53.432294 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-779746e0-c02b-4c02-bdea-e74357aaec6d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:53.546580 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-779746e0-c02b-4c02-bdea-e74357aaec6d tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 28671 microversion: 2.1 time: 0.129243 Jan 28 00:58:53.547254 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 476/932] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:53 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 28671 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:58:53.930270 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-21b97cf1-626d-4492-a180-6efc2080bbc2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:53.930790 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-21b97cf1-626d-4492-a180-6efc2080bbc2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:53.937981 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-21b97cf1-626d-4492-a180-6efc2080bbc2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:53.938440 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-21b97cf1-626d-4492-a180-6efc2080bbc2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:53.939227 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-21b97cf1-626d-4492-a180-6efc2080bbc2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:53.939697 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-21b97cf1-626d-4492-a180-6efc2080bbc2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:54.078563 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-21b97cf1-626d-4492-a180-6efc2080bbc2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:54.086720 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-21b97cf1-626d-4492-a180-6efc2080bbc2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:54.088304 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-21b97cf1-626d-4492-a180-6efc2080bbc2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:54.089516 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-21b97cf1-626d-4492-a180-6efc2080bbc2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1725 microversion: 2.20 time: 0.163095 Jan 28 00:58:54.090051 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 457/933] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:53 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:54.108444 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-160e1788-8483-45e6-8413-68648a53ce92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5b0f0d3-7164-49a1-a4a9-ce1114a65126"}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:54.109598 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-160e1788-8483-45e6-8413-68648a53ce92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:54.116774 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-160e1788-8483-45e6-8413-68648a53ce92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:54.117232 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-160e1788-8483-45e6-8413-68648a53ce92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:54.118038 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-160e1788-8483-45e6-8413-68648a53ce92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:54.118479 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-160e1788-8483-45e6-8413-68648a53ce92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:54.294337 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-d86c1595-123a-43b4-afe1-79de64e230d1 req-5ad41129-16cb-4066-bafc-85d0e6ab6540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449f7a22-44b6-4b73-97ae-5e6103c1f90e", "name": "network-vif-unplugged", "status": "completed", "tag": "3c8d8372-3e6d-4edb-96a4-9c2255946417"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:54.297337 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:58:54.297337 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:58:54.309042 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-d86c1595-123a-43b4-afe1-79de64e230d1 req-5ad41129-16cb-4066-bafc-85d0e6ab6540 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:54.309595 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-d86c1595-123a-43b4-afe1-79de64e230d1 req-5ad41129-16cb-4066-bafc-85d0e6ab6540 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:54.326614 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.compute.server_external_events [req-d86c1595-123a-43b4-afe1-79de64e230d1 req-5ad41129-16cb-4066-bafc-85d0e6ab6540 service nova] Unable to find a host for instance 449f7a22-44b6-4b73-97ae-5e6103c1f90e. Dropping event network-vif-unplugged {{(pid=127863) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 28 00:58:54.327686 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-d86c1595-123a-43b4-afe1-79de64e230d1 req-5ad41129-16cb-4066-bafc-85d0e6ab6540 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041261 Jan 28 00:58:54.328329 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 458/934] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 28 00:58:54.488667 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-160e1788-8483-45e6-8413-68648a53ce92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.385150 Jan 28 00:58:54.489893 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 477/935] 10.222.0.25 () {62 vars in 1363 bytes} [Fri Jan 28 00:58:54 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/os-volume_attachments => generated 188 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:54.558388 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3cdbc005-9ffd-4b90-85c8-77c001ac7ca0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:54.559417 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-3cdbc005-9ffd-4b90-85c8-77c001ac7ca0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:54.566450 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3cdbc005-9ffd-4b90-85c8-77c001ac7ca0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:54.566853 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3cdbc005-9ffd-4b90-85c8-77c001ac7ca0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:54.567592 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3cdbc005-9ffd-4b90-85c8-77c001ac7ca0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:54.568030 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3cdbc005-9ffd-4b90-85c8-77c001ac7ca0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:54.611923 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3a01e3e8-9e9f-4fc5-b57a-d76b2428ba24 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:54.612494 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3a01e3e8-9e9f-4fc5-b57a-d76b2428ba24 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:54.618578 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3a01e3e8-9e9f-4fc5-b57a-d76b2428ba24 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:54.619043 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3a01e3e8-9e9f-4fc5-b57a-d76b2428ba24 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:54.619878 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3a01e3e8-9e9f-4fc5-b57a-d76b2428ba24 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:54.620330 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3a01e3e8-9e9f-4fc5-b57a-d76b2428ba24 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:54.664627 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3cdbc005-9ffd-4b90-85c8-77c001ac7ca0 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 28671 microversion: 2.1 time: 0.109766 Jan 28 00:58:54.665879 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 459/936] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:54 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 28671 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:54.883631 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3a01e3e8-9e9f-4fc5-b57a-d76b2428ba24 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "DELETE /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/os-volume_attachments/f5b0f0d3-7164-49a1-a4a9-ce1114a65126" status: 202 len: 0 microversion: 2.20 time: 0.275303 Jan 28 00:58:54.884290 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 478/937] 10.222.0.25 () {60 vars in 1456 bytes} [Fri Jan 28 00:58:54 2022] DELETE /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/os-volume_attachments/f5b0f0d3-7164-49a1-a4a9-ce1114a65126 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 28 00:58:54.947824 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-63d868de-a708-4f8f-878b-96187826c4d6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:54.948724 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-63d868de-a708-4f8f-878b-96187826c4d6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:54.956560 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-63d868de-a708-4f8f-878b-96187826c4d6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:54.957022 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-63d868de-a708-4f8f-878b-96187826c4d6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:54.957836 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-63d868de-a708-4f8f-878b-96187826c4d6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:54.958321 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-63d868de-a708-4f8f-878b-96187826c4d6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:55.071038 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-63d868de-a708-4f8f-878b-96187826c4d6 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action" status: 202 len: 0 microversion: 2.20 time: 0.127921 Jan 28 00:58:55.071684 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 460/938] 10.222.0.25 () {62 vars in 1318 bytes} [Fri Jan 28 00:58:54 2022] POST /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 28 00:58:55.083204 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-32b8745e-a9f0-4586-b518-32e98ae29a3b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:55.084670 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-32b8745e-a9f0-4586-b518-32e98ae29a3b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:55.095516 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-32b8745e-a9f0-4586-b518-32e98ae29a3b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:55.096045 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-32b8745e-a9f0-4586-b518-32e98ae29a3b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:55.097374 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-32b8745e-a9f0-4586-b518-32e98ae29a3b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:55.098170 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-32b8745e-a9f0-4586-b518-32e98ae29a3b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:55.245623 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-32b8745e-a9f0-4586-b518-32e98ae29a3b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:55.254408 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-32b8745e-a9f0-4586-b518-32e98ae29a3b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:55.255881 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-32b8745e-a9f0-4586-b518-32e98ae29a3b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:55.257071 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-32b8745e-a9f0-4586-b518-32e98ae29a3b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1673 microversion: 2.20 time: 0.179830 Jan 28 00:58:55.257639 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 479/939] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:55 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1673 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:58:55.677784 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3937dd02-450c-42d7-b25f-94798bb218cb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:55.678746 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-3937dd02-450c-42d7-b25f-94798bb218cb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:55.686231 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3937dd02-450c-42d7-b25f-94798bb218cb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:55.686231 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3937dd02-450c-42d7-b25f-94798bb218cb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:55.686814 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3937dd02-450c-42d7-b25f-94798bb218cb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:55.687257 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3937dd02-450c-42d7-b25f-94798bb218cb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:55.787256 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3937dd02-450c-42d7-b25f-94798bb218cb tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 28792 microversion: 2.1 time: 0.113245 Jan 28 00:58:55.791241 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 461/940] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:55 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 28792 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:56.280204 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-668a85f8-0960-46bd-8d17-510350ba91e2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:56.281013 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-668a85f8-0960-46bd-8d17-510350ba91e2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:56.288042 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-668a85f8-0960-46bd-8d17-510350ba91e2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:56.288501 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-668a85f8-0960-46bd-8d17-510350ba91e2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:56.289311 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-668a85f8-0960-46bd-8d17-510350ba91e2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:56.289757 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-668a85f8-0960-46bd-8d17-510350ba91e2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:56.438176 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-668a85f8-0960-46bd-8d17-510350ba91e2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:56.452334 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-668a85f8-0960-46bd-8d17-510350ba91e2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:56.455074 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-668a85f8-0960-46bd-8d17-510350ba91e2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:56.456972 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-668a85f8-0960-46bd-8d17-510350ba91e2 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1731 microversion: 2.20 time: 0.183290 Jan 28 00:58:56.457874 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 480/941] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:56 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:56.800472 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-535f6cf5-bbfa-40d1-b4a5-40537ae630e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:56.801809 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-535f6cf5-bbfa-40d1-b4a5-40537ae630e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:56.810180 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-535f6cf5-bbfa-40d1-b4a5-40537ae630e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:56.810797 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-535f6cf5-bbfa-40d1-b4a5-40537ae630e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:56.811639 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-535f6cf5-bbfa-40d1-b4a5-40537ae630e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:56.812086 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-535f6cf5-bbfa-40d1-b4a5-40537ae630e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:56.914503 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-535f6cf5-bbfa-40d1-b4a5-40537ae630e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 30606 microversion: 2.1 time: 0.119301 Jan 28 00:58:56.915364 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 462/942] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:56 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 30606 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 00:58:57.479174 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-6b0a6ea0-6fb1-4648-9972-0e6912341f73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:57.480297 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-6b0a6ea0-6fb1-4648-9972-0e6912341f73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:57.491476 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6b0a6ea0-6fb1-4648-9972-0e6912341f73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:57.492255 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6b0a6ea0-6fb1-4648-9972-0e6912341f73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:57.493599 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6b0a6ea0-6fb1-4648-9972-0e6912341f73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:57.494319 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6b0a6ea0-6fb1-4648-9972-0e6912341f73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:57.681064 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-6b0a6ea0-6fb1-4648-9972-0e6912341f73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:57.694517 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-6b0a6ea0-6fb1-4648-9972-0e6912341f73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:57.696099 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-6b0a6ea0-6fb1-4648-9972-0e6912341f73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:57.697335 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-6b0a6ea0-6fb1-4648-9972-0e6912341f73 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1731 microversion: 2.20 time: 0.224766 Jan 28 00:58:57.698607 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 481/943] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:57 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1731 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:58:57.927969 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-68cd54c2-2e7a-4fc8-a716-b86dd9ba1c4c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:58:57.929160 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-68cd54c2-2e7a-4fc8-a716-b86dd9ba1c4c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:57.937520 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-68cd54c2-2e7a-4fc8-a716-b86dd9ba1c4c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:57.938355 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-68cd54c2-2e7a-4fc8-a716-b86dd9ba1c4c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:57.939419 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-68cd54c2-2e7a-4fc8-a716-b86dd9ba1c4c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:57.940082 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-68cd54c2-2e7a-4fc8-a716-b86dd9ba1c4c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:58.725927 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-387fbff4-4b88-4015-9355-b5e14abbdf08 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:58.727168 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-387fbff4-4b88-4015-9355-b5e14abbdf08 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:58.740781 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-387fbff4-4b88-4015-9355-b5e14abbdf08 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:58.742046 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-387fbff4-4b88-4015-9355-b5e14abbdf08 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:58.743971 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-387fbff4-4b88-4015-9355-b5e14abbdf08 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:58.745445 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-387fbff4-4b88-4015-9355-b5e14abbdf08 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:58.929433 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-387fbff4-4b88-4015-9355-b5e14abbdf08 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:58.938870 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-387fbff4-4b88-4015-9355-b5e14abbdf08 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:58.940487 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-387fbff4-4b88-4015-9355-b5e14abbdf08 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:58:58.941706 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-387fbff4-4b88-4015-9355-b5e14abbdf08 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1731 microversion: 2.20 time: 0.223031 Jan 28 00:58:58.952931 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 482/944] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:58 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:58:59.960841 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ba997c1c-91a6-485e-984e-2186235d4a6c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:58:59.962215 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ba997c1c-91a6-485e-984e-2186235d4a6c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:58:59.970622 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ba997c1c-91a6-485e-984e-2186235d4a6c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:59.971078 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ba997c1c-91a6-485e-984e-2186235d4a6c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:58:59.971919 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ba997c1c-91a6-485e-984e-2186235d4a6c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:58:59.972639 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ba997c1c-91a6-485e-984e-2186235d4a6c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:00.149525 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ba997c1c-91a6-485e-984e-2186235d4a6c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:00.167541 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ba997c1c-91a6-485e-984e-2186235d4a6c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:00.169505 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ba997c1c-91a6-485e-984e-2186235d4a6c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:00.171371 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ba997c1c-91a6-485e-984e-2186235d4a6c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1731 microversion: 2.20 time: 0.214271 Jan 28 00:59:00.172156 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 483/945] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:58:59 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1731 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:59:01.190713 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-585c1fbe-c0ef-4deb-bc6d-6dd23ce851b1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:01.191378 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-585c1fbe-c0ef-4deb-bc6d-6dd23ce851b1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:01.197782 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-585c1fbe-c0ef-4deb-bc6d-6dd23ce851b1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:01.198240 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-585c1fbe-c0ef-4deb-bc6d-6dd23ce851b1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:01.199510 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-585c1fbe-c0ef-4deb-bc6d-6dd23ce851b1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:01.199895 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-585c1fbe-c0ef-4deb-bc6d-6dd23ce851b1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:01.374117 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-585c1fbe-c0ef-4deb-bc6d-6dd23ce851b1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:01.386058 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-585c1fbe-c0ef-4deb-bc6d-6dd23ce851b1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:01.389542 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-585c1fbe-c0ef-4deb-bc6d-6dd23ce851b1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:01.392449 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-585c1fbe-c0ef-4deb-bc6d-6dd23ce851b1 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1731 microversion: 2.20 time: 0.205026 Jan 28 00:59:01.393248 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 484/946] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:01 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:59:02.420169 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-359a9b79-37a4-4dc8-b8ae-d4ea7e0676d0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:02.421686 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-359a9b79-37a4-4dc8-b8ae-d4ea7e0676d0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:02.433777 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-359a9b79-37a4-4dc8-b8ae-d4ea7e0676d0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:02.435173 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-359a9b79-37a4-4dc8-b8ae-d4ea7e0676d0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:02.436890 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-359a9b79-37a4-4dc8-b8ae-d4ea7e0676d0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:02.437824 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-359a9b79-37a4-4dc8-b8ae-d4ea7e0676d0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:02.593272 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-359a9b79-37a4-4dc8-b8ae-d4ea7e0676d0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:02.610975 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-359a9b79-37a4-4dc8-b8ae-d4ea7e0676d0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:02.614368 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-359a9b79-37a4-4dc8-b8ae-d4ea7e0676d0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:02.616870 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-359a9b79-37a4-4dc8-b8ae-d4ea7e0676d0 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1731 microversion: 2.20 time: 0.206259 Jan 28 00:59:02.633192 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 485/947] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:02 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:59:03.642742 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-b03a2713-185d-45bc-8451-56244d7d0471 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:03.643785 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-b03a2713-185d-45bc-8451-56244d7d0471 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:03.651341 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b03a2713-185d-45bc-8451-56244d7d0471 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:03.651821 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b03a2713-185d-45bc-8451-56244d7d0471 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:03.653017 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b03a2713-185d-45bc-8451-56244d7d0471 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:03.653674 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b03a2713-185d-45bc-8451-56244d7d0471 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:03.855795 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-b03a2713-185d-45bc-8451-56244d7d0471 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:03.870826 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-b03a2713-185d-45bc-8451-56244d7d0471 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:03.874071 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-b03a2713-185d-45bc-8451-56244d7d0471 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:03.876330 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-b03a2713-185d-45bc-8451-56244d7d0471 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1731 microversion: 2.20 time: 0.238346 Jan 28 00:59:03.877708 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 486/948] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:03 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1731 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:59:04.897419 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9d6f872e-69b9-4d7d-8914-cb4ad69ab333 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:04.898524 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9d6f872e-69b9-4d7d-8914-cb4ad69ab333 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:04.907234 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d6f872e-69b9-4d7d-8914-cb4ad69ab333 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:04.907765 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d6f872e-69b9-4d7d-8914-cb4ad69ab333 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:04.908579 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d6f872e-69b9-4d7d-8914-cb4ad69ab333 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:04.909023 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d6f872e-69b9-4d7d-8914-cb4ad69ab333 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:05.075680 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9d6f872e-69b9-4d7d-8914-cb4ad69ab333 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:05.084980 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9d6f872e-69b9-4d7d-8914-cb4ad69ab333 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:05.086743 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9d6f872e-69b9-4d7d-8914-cb4ad69ab333 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:05.088200 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9d6f872e-69b9-4d7d-8914-cb4ad69ab333 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1731 microversion: 2.20 time: 0.195451 Jan 28 00:59:05.089076 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 487/949] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:04 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:59:06.113146 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ff3b47d5-f83d-4567-83c3-8c88dffd7881 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:06.115476 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ff3b47d5-f83d-4567-83c3-8c88dffd7881 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:06.123694 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ff3b47d5-f83d-4567-83c3-8c88dffd7881 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:06.124324 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ff3b47d5-f83d-4567-83c3-8c88dffd7881 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:06.125227 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ff3b47d5-f83d-4567-83c3-8c88dffd7881 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:06.125795 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ff3b47d5-f83d-4567-83c3-8c88dffd7881 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:06.328195 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ff3b47d5-f83d-4567-83c3-8c88dffd7881 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:06.337151 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ff3b47d5-f83d-4567-83c3-8c88dffd7881 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:06.338859 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ff3b47d5-f83d-4567-83c3-8c88dffd7881 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:06.340253 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ff3b47d5-f83d-4567-83c3-8c88dffd7881 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1731 microversion: 2.20 time: 0.233894 Jan 28 00:59:06.341486 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 488/950] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:06 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:59:07.032955 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-68cd54c2-2e7a-4fc8-a716-b86dd9ba1c4c tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 38196 microversion: 2.1 time: 9.108762 Jan 28 00:59:07.033857 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 463/951] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:58:57 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 38196 bytes in 9111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:59:07.366657 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7b859343-14a4-4bc7-a560-3c7ac72c3226 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:07.367453 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7b859343-14a4-4bc7-a560-3c7ac72c3226 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:07.375579 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7b859343-14a4-4bc7-a560-3c7ac72c3226 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:07.376325 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7b859343-14a4-4bc7-a560-3c7ac72c3226 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:07.377745 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7b859343-14a4-4bc7-a560-3c7ac72c3226 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:07.378225 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7b859343-14a4-4bc7-a560-3c7ac72c3226 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:07.615253 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7b859343-14a4-4bc7-a560-3c7ac72c3226 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:07.629020 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7b859343-14a4-4bc7-a560-3c7ac72c3226 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:07.631647 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7b859343-14a4-4bc7-a560-3c7ac72c3226 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:07.633893 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7b859343-14a4-4bc7-a560-3c7ac72c3226 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1731 microversion: 2.20 time: 0.271278 Jan 28 00:59:07.634953 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 489/952] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:07 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1731 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:59:08.046811 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b3745826-7854-4929-8541-558b8e707a38 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:08.047938 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b3745826-7854-4929-8541-558b8e707a38 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:08.055431 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b3745826-7854-4929-8541-558b8e707a38 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:08.055891 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b3745826-7854-4929-8541-558b8e707a38 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:08.056801 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b3745826-7854-4929-8541-558b8e707a38 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:08.057248 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b3745826-7854-4929-8541-558b8e707a38 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:08.190915 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b3745826-7854-4929-8541-558b8e707a38 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action" status: 200 len: 38327 microversion: 2.1 time: 0.147615 Jan 28 00:59:08.192143 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 464/953] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 00:59:08 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/action => generated 38327 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 00:59:08.209276 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-926922bd-1d25-4f46-bc2d-de41fddab014 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:08.210169 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-926922bd-1d25-4f46-bc2d-de41fddab014 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:08.222263 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-926922bd-1d25-4f46-bc2d-de41fddab014 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:08.223062 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-926922bd-1d25-4f46-bc2d-de41fddab014 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:08.224494 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-926922bd-1d25-4f46-bc2d-de41fddab014 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:08.225274 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-926922bd-1d25-4f46-bc2d-de41fddab014 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:08.273409 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-926922bd-1d25-4f46-bc2d-de41fddab014 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/ips" status: 200 len: 144 microversion: 2.1 time: 0.070627 Jan 28 00:59:08.275178 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 490/954] 10.222.0.25 () {58 vars in 1247 bytes} [Fri Jan 28 00:59:08 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/ips => generated 144 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:59:08.667052 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-867bde9f-373d-4774-9e7d-f76a7a13eecf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:08.671596 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-867bde9f-373d-4774-9e7d-f76a7a13eecf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:08.681526 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-867bde9f-373d-4774-9e7d-f76a7a13eecf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:08.681984 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-867bde9f-373d-4774-9e7d-f76a7a13eecf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:08.682810 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-867bde9f-373d-4774-9e7d-f76a7a13eecf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:08.683441 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-867bde9f-373d-4774-9e7d-f76a7a13eecf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:08.859688 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-867bde9f-373d-4774-9e7d-f76a7a13eecf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:08.868652 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-867bde9f-373d-4774-9e7d-f76a7a13eecf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:08.870378 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-867bde9f-373d-4774-9e7d-f76a7a13eecf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:08.872061 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-867bde9f-373d-4774-9e7d-f76a7a13eecf tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1731 microversion: 2.20 time: 0.211679 Jan 28 00:59:08.873891 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 465/955] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:08 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1731 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:59:09.752705 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-83643dd7-4964-48d6-85e7-8a92130546a9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73777cea-bafb-4e45-919b-4d42eb4a9890"}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:09.753894 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-83643dd7-4964-48d6-85e7-8a92130546a9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:09.761221 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-83643dd7-4964-48d6-85e7-8a92130546a9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:09.761806 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-83643dd7-4964-48d6-85e7-8a92130546a9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:09.762747 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-83643dd7-4964-48d6-85e7-8a92130546a9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:09.763803 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-83643dd7-4964-48d6-85e7-8a92130546a9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:09.901017 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-bfe582d4-a969-4489-8b5e-3da0d6dd18de tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:09.902201 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-bfe582d4-a969-4489-8b5e-3da0d6dd18de tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:09.915641 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bfe582d4-a969-4489-8b5e-3da0d6dd18de tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:09.916463 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bfe582d4-a969-4489-8b5e-3da0d6dd18de tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:09.918132 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bfe582d4-a969-4489-8b5e-3da0d6dd18de tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:09.919594 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bfe582d4-a969-4489-8b5e-3da0d6dd18de tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:10.132624 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-83643dd7-4964-48d6-85e7-8a92130546a9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383375 Jan 28 00:59:10.133576 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 491/956] 10.222.0.25 () {60 vars in 1322 bytes} [Fri Jan 28 00:59:09 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:59:10.161309 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-bfe582d4-a969-4489-8b5e-3da0d6dd18de tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:10.172496 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-bfe582d4-a969-4489-8b5e-3da0d6dd18de tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:10.174396 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-bfe582d4-a969-4489-8b5e-3da0d6dd18de tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:10.176408 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-bfe582d4-a969-4489-8b5e-3da0d6dd18de tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1731 microversion: 2.20 time: 0.282746 Jan 28 00:59:10.179322 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 466/957] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:09 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1731 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:59:10.392893 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-4f132bec-da1f-42ae-b38b-3dac99c0fdac req-627eb89c-0a83-4f5c-80f6-a41bffea5a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449f7a22-44b6-4b73-97ae-5e6103c1f90e", "name": "network-vif-plugged", "status": "completed", "tag": "3c8d8372-3e6d-4edb-96a4-9c2255946417"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:10.396231 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:59:10.396231 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:59:10.411855 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-4f132bec-da1f-42ae-b38b-3dac99c0fdac req-627eb89c-0a83-4f5c-80f6-a41bffea5a0d service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:10.412649 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-4f132bec-da1f-42ae-b38b-3dac99c0fdac req-627eb89c-0a83-4f5c-80f6-a41bffea5a0d service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:10.439255 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-4f132bec-da1f-42ae-b38b-3dac99c0fdac req-627eb89c-0a83-4f5c-80f6-a41bffea5a0d service nova] Creating event network-vif-plugged:3c8d8372-3e6d-4edb-96a4-9c2255946417 for instance 449f7a22-44b6-4b73-97ae-5e6103c1f90e on hv-cinder-80952 Jan 28 00:59:10.448929 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-4f132bec-da1f-42ae-b38b-3dac99c0fdac req-627eb89c-0a83-4f5c-80f6-a41bffea5a0d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065452 Jan 28 00:59:10.449824 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 492/958] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:59:11.210644 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7a5edca4-2eb6-4897-a4a1-56ededa30942 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:11.211737 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7a5edca4-2eb6-4897-a4a1-56ededa30942 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:11.223788 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7a5edca4-2eb6-4897-a4a1-56ededa30942 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:11.224512 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7a5edca4-2eb6-4897-a4a1-56ededa30942 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:11.225821 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7a5edca4-2eb6-4897-a4a1-56ededa30942 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:11.226530 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7a5edca4-2eb6-4897-a4a1-56ededa30942 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:11.423990 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7a5edca4-2eb6-4897-a4a1-56ededa30942 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:11.433493 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7a5edca4-2eb6-4897-a4a1-56ededa30942 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:11.435919 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7a5edca4-2eb6-4897-a4a1-56ededa30942 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:11.437185 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7a5edca4-2eb6-4897-a4a1-56ededa30942 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1731 microversion: 2.20 time: 0.233761 Jan 28 00:59:11.437775 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 467/959] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:11 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1731 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:59:12.456573 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-42bea232-b20f-482c-9944-93380e78332f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:12.457491 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-42bea232-b20f-482c-9944-93380e78332f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:12.464551 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-42bea232-b20f-482c-9944-93380e78332f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:12.465045 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-42bea232-b20f-482c-9944-93380e78332f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:12.465851 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-42bea232-b20f-482c-9944-93380e78332f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:12.466802 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-42bea232-b20f-482c-9944-93380e78332f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:12.641166 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-42bea232-b20f-482c-9944-93380e78332f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:12.653103 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-42bea232-b20f-482c-9944-93380e78332f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:12.655051 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-42bea232-b20f-482c-9944-93380e78332f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:12.656675 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-42bea232-b20f-482c-9944-93380e78332f tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1731 microversion: 2.20 time: 0.204344 Jan 28 00:59:12.659313 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 493/960] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:12 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1731 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:59:13.689123 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e78b9084-0738-4c2b-b5e5-482e35b22fbd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:13.689956 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e78b9084-0738-4c2b-b5e5-482e35b22fbd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:13.699883 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e78b9084-0738-4c2b-b5e5-482e35b22fbd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:13.701199 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e78b9084-0738-4c2b-b5e5-482e35b22fbd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:13.702098 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e78b9084-0738-4c2b-b5e5-482e35b22fbd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:13.702556 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e78b9084-0738-4c2b-b5e5-482e35b22fbd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:13.900652 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e78b9084-0738-4c2b-b5e5-482e35b22fbd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:13.912300 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e78b9084-0738-4c2b-b5e5-482e35b22fbd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:13.913995 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e78b9084-0738-4c2b-b5e5-482e35b22fbd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:13.915159 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e78b9084-0738-4c2b-b5e5-482e35b22fbd tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1718 microversion: 2.20 time: 0.231952 Jan 28 00:59:13.915752 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 468/961] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:13 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1718 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:59:17.760055 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-92104afe-82bd-4342-ba6e-7f7cd3d72299 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:17.760992 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-92104afe-82bd-4342-ba6e-7f7cd3d72299 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:17.768484 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-92104afe-82bd-4342-ba6e-7f7cd3d72299 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:17.768938 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-92104afe-82bd-4342-ba6e-7f7cd3d72299 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:17.769743 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-92104afe-82bd-4342-ba6e-7f7cd3d72299 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:17.770184 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-92104afe-82bd-4342-ba6e-7f7cd3d72299 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:17.801354 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-92104afe-82bd-4342-ba6e-7f7cd3d72299 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045014 Jan 28 00:59:17.801941 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 494/962] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 00:59:17 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:59:17.813328 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-dd140053-6bab-4789-9089-547e48b909fe tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:17.813884 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-dd140053-6bab-4789-9089-547e48b909fe tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:17.820283 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-dd140053-6bab-4789-9089-547e48b909fe tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:17.820733 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-dd140053-6bab-4789-9089-547e48b909fe tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:17.821516 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-dd140053-6bab-4789-9089-547e48b909fe tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:17.821954 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-dd140053-6bab-4789-9089-547e48b909fe tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:17.851285 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-dd140053-6bab-4789-9089-547e48b909fe tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments/73777cea-bafb-4e45-919b-4d42eb4a9890" status: 200 len: 194 microversion: 2.1 time: 0.042252 Jan 28 00:59:17.851889 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 469/963] 10.222.0.25 () {58 vars in 1412 bytes} [Fri Jan 28 00:59:17 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments/73777cea-bafb-4e45-919b-4d42eb4a9890 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:59:19.175167 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-458c9e47-9e4d-40a7-a0a6-5a5daef86c72 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9def815f-6450-4dd1-a59b-b41aa3c1474f"}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:19.176257 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-458c9e47-9e4d-40a7-a0a6-5a5daef86c72 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:19.182655 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-458c9e47-9e4d-40a7-a0a6-5a5daef86c72 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:19.183106 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-458c9e47-9e4d-40a7-a0a6-5a5daef86c72 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:19.183997 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-458c9e47-9e4d-40a7-a0a6-5a5daef86c72 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:19.184439 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-458c9e47-9e4d-40a7-a0a6-5a5daef86c72 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:19.491659 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-458c9e47-9e4d-40a7-a0a6-5a5daef86c72 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320024 Jan 28 00:59:19.492538 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 495/964] 10.222.0.25 () {60 vars in 1322 bytes} [Fri Jan 28 00:59:19 2022] POST /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:59:27.018853 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-dc4d37d9-1e52-4d2d-afe9-64a97118da2f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:27.019817 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-dc4d37d9-1e52-4d2d-afe9-64a97118da2f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:27.026392 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-dc4d37d9-1e52-4d2d-afe9-64a97118da2f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:27.026846 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-dc4d37d9-1e52-4d2d-afe9-64a97118da2f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:27.027789 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-dc4d37d9-1e52-4d2d-afe9-64a97118da2f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:27.028243 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-dc4d37d9-1e52-4d2d-afe9-64a97118da2f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:27.065235 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-dc4d37d9-1e52-4d2d-afe9-64a97118da2f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050392 Jan 28 00:59:27.065826 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 470/965] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 00:59:27 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:59:27.333345 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d2b41933-1f58-4134-a788-9b6997689733 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:27.333966 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d2b41933-1f58-4134-a788-9b6997689733 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:27.340171 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d2b41933-1f58-4134-a788-9b6997689733 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:27.340632 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d2b41933-1f58-4134-a788-9b6997689733 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:27.341929 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d2b41933-1f58-4134-a788-9b6997689733 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:27.342365 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d2b41933-1f58-4134-a788-9b6997689733 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:27.372496 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d2b41933-1f58-4134-a788-9b6997689733 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments/73777cea-bafb-4e45-919b-4d42eb4a9890" status: 200 len: 194 microversion: 2.1 time: 0.043706 Jan 28 00:59:27.373269 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 496/966] 10.222.0.25 () {58 vars in 1412 bytes} [Fri Jan 28 00:59:27 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments/73777cea-bafb-4e45-919b-4d42eb4a9890 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:59:27.383232 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a6e2e97a-c1e7-4815-beac-f23a2777f208 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:27.383884 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a6e2e97a-c1e7-4815-beac-f23a2777f208 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:27.390646 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a6e2e97a-c1e7-4815-beac-f23a2777f208 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:27.391316 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a6e2e97a-c1e7-4815-beac-f23a2777f208 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:27.392473 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a6e2e97a-c1e7-4815-beac-f23a2777f208 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:27.393291 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a6e2e97a-c1e7-4815-beac-f23a2777f208 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:27.476435 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.objects.instance [None req-a6e2e97a-c1e7-4815-beac-f23a2777f208 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lazy-loading 'services' on Instance uuid 64723bd1-f578-4d8a-b562-971874536f1d {{(pid=127863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:59:27.548136 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a6e2e97a-c1e7-4815-beac-f23a2777f208 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "DELETE /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments/73777cea-bafb-4e45-919b-4d42eb4a9890" status: 202 len: 0 microversion: 2.1 time: 0.169017 Jan 28 00:59:27.548742 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 471/967] 10.222.0.25 () {58 vars in 1415 bytes} [Fri Jan 28 00:59:27 2022] DELETE /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments/73777cea-bafb-4e45-919b-4d42eb4a9890 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:29.726903 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f1046421-3d0b-4dd7-bcea-8eef9971c0e2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:29.727672 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f1046421-3d0b-4dd7-bcea-8eef9971c0e2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:29.737074 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f1046421-3d0b-4dd7-bcea-8eef9971c0e2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:29.737732 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f1046421-3d0b-4dd7-bcea-8eef9971c0e2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:29.738763 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f1046421-3d0b-4dd7-bcea-8eef9971c0e2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:29.739418 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f1046421-3d0b-4dd7-bcea-8eef9971c0e2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:29.776108 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f1046421-3d0b-4dd7-bcea-8eef9971c0e2 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments/9def815f-6450-4dd1-a59b-b41aa3c1474f" status: 200 len: 194 microversion: 2.1 time: 0.053272 Jan 28 00:59:29.776758 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 497/968] 10.222.0.25 () {58 vars in 1412 bytes} [Fri Jan 28 00:59:29 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments/9def815f-6450-4dd1-a59b-b41aa3c1474f => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:59:29.790798 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0b53f372-555b-4794-9cf5-9317271bcc10 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:29.806052 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0b53f372-555b-4794-9cf5-9317271bcc10 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:29.806052 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0b53f372-555b-4794-9cf5-9317271bcc10 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:29.806052 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0b53f372-555b-4794-9cf5-9317271bcc10 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:29.806846 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0b53f372-555b-4794-9cf5-9317271bcc10 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:29.807323 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0b53f372-555b-4794-9cf5-9317271bcc10 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:29.905044 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.objects.instance [None req-0b53f372-555b-4794-9cf5-9317271bcc10 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lazy-loading 'services' on Instance uuid 64723bd1-f578-4d8a-b562-971874536f1d {{(pid=127863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:59:29.983005 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0b53f372-555b-4794-9cf5-9317271bcc10 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "DELETE /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments/9def815f-6450-4dd1-a59b-b41aa3c1474f" status: 202 len: 0 microversion: 2.1 time: 0.196956 Jan 28 00:59:29.983820 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 472/969] 10.222.0.25 () {58 vars in 1415 bytes} [Fri Jan 28 00:59:29 2022] DELETE /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments/9def815f-6450-4dd1-a59b-b41aa3c1474f => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:31.152219 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-00bd668e-af76-47d7-aad4-a6d16a9727cf tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:31.153195 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-00bd668e-af76-47d7-aad4-a6d16a9727cf tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:31.160455 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-00bd668e-af76-47d7-aad4-a6d16a9727cf tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:31.160911 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-00bd668e-af76-47d7-aad4-a6d16a9727cf tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:31.161710 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-00bd668e-af76-47d7-aad4-a6d16a9727cf tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:31.162162 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-00bd668e-af76-47d7-aad4-a6d16a9727cf tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:31.192810 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-00bd668e-af76-47d7-aad4-a6d16a9727cf tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044171 Jan 28 00:59:31.193298 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 498/970] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 00:59:31 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 00:59:31.301828 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2c545e68-a9df-4cd6-9df6-33ba07fb7daa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:31.302886 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2c545e68-a9df-4cd6-9df6-33ba07fb7daa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:31.309222 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2c545e68-a9df-4cd6-9df6-33ba07fb7daa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:31.309673 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2c545e68-a9df-4cd6-9df6-33ba07fb7daa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:31.310828 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2c545e68-a9df-4cd6-9df6-33ba07fb7daa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:31.311288 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2c545e68-a9df-4cd6-9df6-33ba07fb7daa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:31.343797 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2c545e68-a9df-4cd6-9df6-33ba07fb7daa tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046430 Jan 28 00:59:31.344385 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 473/971] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 00:59:31 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 00:59:31.401893 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-b758d556-20cc-4f41-ab27-d29d308d1398 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:31.402404 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-b758d556-20cc-4f41-ab27-d29d308d1398 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:31.409731 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b758d556-20cc-4f41-ab27-d29d308d1398 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:31.410328 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b758d556-20cc-4f41-ab27-d29d308d1398 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:31.411245 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b758d556-20cc-4f41-ab27-d29d308d1398 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:31.411835 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b758d556-20cc-4f41-ab27-d29d308d1398 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:31.438299 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-b758d556-20cc-4f41-ab27-d29d308d1398 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Going to try to terminate instance {{(pid=127862) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 00:59:31.525019 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-b758d556-20cc-4f41-ab27-d29d308d1398 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "DELETE /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 204 len: 0 microversion: 2.1 time: 0.126030 Jan 28 00:59:31.525911 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 499/972] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 00:59:31 2022] DELETE /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 00:59:31.536428 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-35a2fd97-32ee-400a-9d40-a6140781ec5f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:31.537047 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-35a2fd97-32ee-400a-9d40-a6140781ec5f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:31.543070 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-35a2fd97-32ee-400a-9d40-a6140781ec5f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:31.543557 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-35a2fd97-32ee-400a-9d40-a6140781ec5f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:31.544869 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-35a2fd97-32ee-400a-9d40-a6140781ec5f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:31.545308 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-35a2fd97-32ee-400a-9d40-a6140781ec5f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:31.682775 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-35a2fd97-32ee-400a-9d40-a6140781ec5f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:31.690971 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-35a2fd97-32ee-400a-9d40-a6140781ec5f tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 200 len: 1672 microversion: 2.1 time: 0.158667 Jan 28 00:59:31.691594 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 474/973] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:31 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:32.712131 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-deb3ec7f-012d-4e43-9c24-295b1615294a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:32.712993 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-deb3ec7f-012d-4e43-9c24-295b1615294a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:32.722025 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-deb3ec7f-012d-4e43-9c24-295b1615294a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:32.722025 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-deb3ec7f-012d-4e43-9c24-295b1615294a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:32.726153 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-deb3ec7f-012d-4e43-9c24-295b1615294a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:32.726153 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-deb3ec7f-012d-4e43-9c24-295b1615294a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:32.881283 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-deb3ec7f-012d-4e43-9c24-295b1615294a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:32.890151 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-deb3ec7f-012d-4e43-9c24-295b1615294a tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 200 len: 1672 microversion: 2.1 time: 0.184706 Jan 28 00:59:32.893983 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 500/974] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:32 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 1672 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:33.907763 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-22dfb994-1498-4f72-9c4d-5fd80951aea3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:33.908372 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-22dfb994-1498-4f72-9c4d-5fd80951aea3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:33.914795 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-22dfb994-1498-4f72-9c4d-5fd80951aea3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:33.915251 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-22dfb994-1498-4f72-9c4d-5fd80951aea3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:33.916094 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-22dfb994-1498-4f72-9c4d-5fd80951aea3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:33.916544 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-22dfb994-1498-4f72-9c4d-5fd80951aea3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:34.070153 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-22dfb994-1498-4f72-9c4d-5fd80951aea3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:34.078270 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-22dfb994-1498-4f72-9c4d-5fd80951aea3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 200 len: 1672 microversion: 2.1 time: 0.174574 Jan 28 00:59:34.078857 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 475/975] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:33 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 1672 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:35.100927 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d6072a76-fe49-4e4b-b11d-2f5f32cc26e3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:35.101674 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d6072a76-fe49-4e4b-b11d-2f5f32cc26e3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:35.109434 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d6072a76-fe49-4e4b-b11d-2f5f32cc26e3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:35.109904 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d6072a76-fe49-4e4b-b11d-2f5f32cc26e3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:35.110829 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d6072a76-fe49-4e4b-b11d-2f5f32cc26e3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:35.111436 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d6072a76-fe49-4e4b-b11d-2f5f32cc26e3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:35.191086 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d6072a76-fe49-4e4b-b11d-2f5f32cc26e3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f7380dfc9f44ee2acddd560f1968989', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e774ad4314a49b4a0a8db735e0d8424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:35.200125 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d6072a76-fe49-4e4b-b11d-2f5f32cc26e3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 200 len: 1605 microversion: 2.1 time: 0.103624 Jan 28 00:59:35.201567 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 501/976] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:35 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 1605 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:35.523830 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-e63b46ef-9381-4d1a-80c1-e352e1ba7bd5 req-dfe00c19-bdeb-4fb2-b93d-c2d19564e5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64723bd1-f578-4d8a-b562-971874536f1d", "name": "network-vif-deleted", "tag": "8839566b-538e-4d4a-b002-3de919d10b4d"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:35.525586 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:59:35.525586 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:59:35.534808 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-e63b46ef-9381-4d1a-80c1-e352e1ba7bd5 req-dfe00c19-bdeb-4fb2-b93d-c2d19564e5b3 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:35.535259 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-e63b46ef-9381-4d1a-80c1-e352e1ba7bd5 req-dfe00c19-bdeb-4fb2-b93d-c2d19564e5b3 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:35.547541 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-e63b46ef-9381-4d1a-80c1-e352e1ba7bd5 req-dfe00c19-bdeb-4fb2-b93d-c2d19564e5b3 service nova] Creating event network-vif-deleted:8839566b-538e-4d4a-b002-3de919d10b4d for instance 64723bd1-f578-4d8a-b562-971874536f1d on hv-cinder-80952 Jan 28 00:59:35.553693 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-e63b46ef-9381-4d1a-80c1-e352e1ba7bd5 req-dfe00c19-bdeb-4fb2-b93d-c2d19564e5b3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032789 Jan 28 00:59:35.556765 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 476/977] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:59:36.226717 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-76626762-6364-43c1-ba9b-03da12f92419 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:36.227357 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-76626762-6364-43c1-ba9b-03da12f92419 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:36.234669 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-76626762-6364-43c1-ba9b-03da12f92419 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:36.235155 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-76626762-6364-43c1-ba9b-03da12f92419 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:36.236069 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-76626762-6364-43c1-ba9b-03da12f92419 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:36.236674 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-76626762-6364-43c1-ba9b-03da12f92419 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:36.251767 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-76626762-6364-43c1-ba9b-03da12f92419 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] HTTP exception thrown: Instance 64723bd1-f578-4d8a-b562-971874536f1d could not be found. Jan 28 00:59:36.252387 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-76626762-6364-43c1-ba9b-03da12f92419 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Returning 404 to user: Instance 64723bd1-f578-4d8a-b562-971874536f1d could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:59:36.253253 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-76626762-6364-43c1-ba9b-03da12f92419 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 404 len: 111 microversion: 2.1 time: 0.030645 Jan 28 00:59:36.253839 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 502/978] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:36 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:59:36.263085 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1bd2e09d-a9c1-498f-abaf-36a5877b4b85 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '.version_select at 0x7fbbc2241430>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:36.286457 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1bd2e09d-a9c1-498f-abaf-36a5877b4b85 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1890601314" status: 202 len: 0 microversion: 2.1 time: 0.027529 Jan 28 00:59:36.287062 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 477/979] 10.222.0.25 () {58 vars in 1220 bytes} [Fri Jan 28 00:59:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1890601314 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 00:59:39.350612 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-6a7f8009-0e65-4060-b99d-758d629dcec3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:39.351561 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-6a7f8009-0e65-4060-b99d-758d629dcec3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:39.365942 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6a7f8009-0e65-4060-b99d-758d629dcec3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:39.366794 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6a7f8009-0e65-4060-b99d-758d629dcec3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:39.368609 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6a7f8009-0e65-4060-b99d-758d629dcec3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:39.369272 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6a7f8009-0e65-4060-b99d-758d629dcec3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:39.399080 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-6a7f8009-0e65-4060-b99d-758d629dcec3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] HTTP exception thrown: Instance 64723bd1-f578-4d8a-b562-971874536f1d could not be found. Jan 28 00:59:39.400408 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-6a7f8009-0e65-4060-b99d-758d629dcec3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Returning 404 to user: Instance 64723bd1-f578-4d8a-b562-971874536f1d could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:59:39.401765 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-6a7f8009-0e65-4060-b99d-758d629dcec3 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "DELETE /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 404 len: 111 microversion: 2.1 time: 0.058242 Jan 28 00:59:39.402652 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 503/980] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 00:59:39 2022] DELETE /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:59:39.415220 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-23e18874-1f82-4dcb-8dd4-a2d1bb6e67e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:39.416488 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-23e18874-1f82-4dcb-8dd4-a2d1bb6e67e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: 64723bd1-f578-4d8a-b562-971874536f1d] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:39.425837 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-23e18874-1f82-4dcb-8dd4-a2d1bb6e67e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:39.426360 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-23e18874-1f82-4dcb-8dd4-a2d1bb6e67e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:39.427214 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-23e18874-1f82-4dcb-8dd4-a2d1bb6e67e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:39.427694 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-23e18874-1f82-4dcb-8dd4-a2d1bb6e67e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:39.443955 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-23e18874-1f82-4dcb-8dd4-a2d1bb6e67e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] HTTP exception thrown: Instance 64723bd1-f578-4d8a-b562-971874536f1d could not be found. Jan 28 00:59:39.444570 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-23e18874-1f82-4dcb-8dd4-a2d1bb6e67e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Returning 404 to user: Instance 64723bd1-f578-4d8a-b562-971874536f1d could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:59:39.445548 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-23e18874-1f82-4dcb-8dd4-a2d1bb6e67e9 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d" status: 404 len: 111 microversion: 2.1 time: 0.037486 Jan 28 00:59:39.446202 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 478/981] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:39 2022] GET /compute/v2.1/servers/64723bd1-f578-4d8a-b562-971874536f1d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:59:40.621848 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-eea73fd5-bce3-4fd1-bbb7-467e188dfa41 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:40.622480 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-eea73fd5-bce3-4fd1-bbb7-467e188dfa41 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:40.629466 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-eea73fd5-bce3-4fd1-bbb7-467e188dfa41 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:40.629926 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-eea73fd5-bce3-4fd1-bbb7-467e188dfa41 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:40.630731 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-eea73fd5-bce3-4fd1-bbb7-467e188dfa41 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:40.631175 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-eea73fd5-bce3-4fd1-bbb7-467e188dfa41 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:40.645733 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-eea73fd5-bce3-4fd1-bbb7-467e188dfa41 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] HTTP exception thrown: Instance a4dbbfd4-609c-4041-b0b5-b939f759eecd could not be found. Jan 28 00:59:40.646332 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-eea73fd5-bce3-4fd1-bbb7-467e188dfa41 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Returning 404 to user: Instance a4dbbfd4-609c-4041-b0b5-b939f759eecd could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:59:40.647179 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-eea73fd5-bce3-4fd1-bbb7-467e188dfa41 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "DELETE /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 404 len: 111 microversion: 2.1 time: 0.029296 Jan 28 00:59:40.647788 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 504/982] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 00:59:40 2022] DELETE /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 00:59:40.656530 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-84890d78-6a37-4685-8b9a-ad00531ac5d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:40.657149 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-84890d78-6a37-4685-8b9a-ad00531ac5d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] [instance: a4dbbfd4-609c-4041-b0b5-b939f759eecd] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:40.663573 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-84890d78-6a37-4685-8b9a-ad00531ac5d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:40.664061 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-84890d78-6a37-4685-8b9a-ad00531ac5d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:40.664964 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-84890d78-6a37-4685-8b9a-ad00531ac5d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:40.665404 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-84890d78-6a37-4685-8b9a-ad00531ac5d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:40.680931 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-84890d78-6a37-4685-8b9a-ad00531ac5d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] HTTP exception thrown: Instance a4dbbfd4-609c-4041-b0b5-b939f759eecd could not be found. Jan 28 00:59:40.681566 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-84890d78-6a37-4685-8b9a-ad00531ac5d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] Returning 404 to user: Instance a4dbbfd4-609c-4041-b0b5-b939f759eecd could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:59:40.682417 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-84890d78-6a37-4685-8b9a-ad00531ac5d6 tempest-AttachVolumeTestJSON-1121374080 tempest-AttachVolumeTestJSON-1121374080-project] 10.222.0.25 "GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd" status: 404 len: 111 microversion: 2.1 time: 0.030410 Jan 28 00:59:40.682967 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 479/983] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:40 2022] GET /compute/v2.1/servers/a4dbbfd4-609c-4041-b0b5-b939f759eecd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 00:59:47.367779 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-fdfdcfc9-6903-4f57-855e-5f82feffd23c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:47.368699 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-fdfdcfc9-6903-4f57-855e-5f82feffd23c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:47.375048 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fdfdcfc9-6903-4f57-855e-5f82feffd23c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:47.375538 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fdfdcfc9-6903-4f57-855e-5f82feffd23c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:47.376338 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fdfdcfc9-6903-4f57-855e-5f82feffd23c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:47.376767 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fdfdcfc9-6903-4f57-855e-5f82feffd23c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:47.416847 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-fdfdcfc9-6903-4f57-855e-5f82feffd23c tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052824 Jan 28 00:59:47.417544 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 505/984] 10.222.0.25 () {60 vars in 1342 bytes} [Fri Jan 28 00:59:47 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:47.471840 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4898f113-debe-48f0-b4ac-4d71e4a5fc68 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:47.472294 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4898f113-debe-48f0-b4ac-4d71e4a5fc68 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:47.478143 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4898f113-debe-48f0-b4ac-4d71e4a5fc68 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:47.478603 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4898f113-debe-48f0-b4ac-4d71e4a5fc68 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:47.479432 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4898f113-debe-48f0-b4ac-4d71e4a5fc68 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:47.480001 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4898f113-debe-48f0-b4ac-4d71e4a5fc68 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:47.505754 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4898f113-debe-48f0-b4ac-4d71e4a5fc68 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Going to try to terminate instance {{(pid=127862) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 00:59:47.511833 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-423d035f-3a4e-4408-8519-c2c4a1de7e0f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1183546714", "imageRef": "7fe09c59-2ff9-4639-b39d-9a474e83ad91", "flavorRef": "452", "networks": [{"uuid": "24e25033-acbb-46d6-9923-f2b3f53599d8"}]}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:47.566882 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.network.neutron [None req-423d035f-3a4e-4408-8519-c2c4a1de7e0f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] validate_networks() for [('24e25033-acbb-46d6-9923-f2b3f53599d8', None, None, None, None, None)] {{(pid=127863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 00:59:47.588137 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4898f113-debe-48f0-b4ac-4d71e4a5fc68 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "DELETE /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 204 len: 0 microversion: 2.20 time: 0.119518 Jan 28 00:59:47.592643 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 506/985] 10.222.0.25 () {60 vars in 1279 bytes} [Fri Jan 28 00:59:47 2022] DELETE /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 28 00:59:47.598141 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-8b2bff42-dac9-4140-9f9d-1c41c43d35ea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:47.598836 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-8b2bff42-dac9-4140-9f9d-1c41c43d35ea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:47.604719 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8b2bff42-dac9-4140-9f9d-1c41c43d35ea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:47.605182 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8b2bff42-dac9-4140-9f9d-1c41c43d35ea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:47.605982 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8b2bff42-dac9-4140-9f9d-1c41c43d35ea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:47.606429 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8b2bff42-dac9-4140-9f9d-1c41c43d35ea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:47.869157 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-8b2bff42-dac9-4140-9f9d-1c41c43d35ea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:47.877845 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-8b2bff42-dac9-4140-9f9d-1c41c43d35ea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:47.879426 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-8b2bff42-dac9-4140-9f9d-1c41c43d35ea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:47.880604 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-8b2bff42-dac9-4140-9f9d-1c41c43d35ea tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1724 microversion: 2.20 time: 0.286555 Jan 28 00:59:47.881178 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 507/986] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:47 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:59:48.011062 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-423d035f-3a4e-4408-8519-c2c4a1de7e0f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Flavor limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 00:59:48.011524 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-423d035f-3a4e-4408-8519-c2c4a1de7e0f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Image limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 00:59:48.011994 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-423d035f-3a4e-4408-8519-c2c4a1de7e0f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Flavor pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 00:59:48.012405 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-423d035f-3a4e-4408-8519-c2c4a1de7e0f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Image pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 00:59:48.012819 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-423d035f-3a4e-4408-8519-c2c4a1de7e0f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 00:59:48.022505 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-423d035f-3a4e-4408-8519-c2c4a1de7e0f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:48.022954 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-423d035f-3a4e-4408-8519-c2c4a1de7e0f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:48.023793 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-423d035f-3a4e-4408-8519-c2c4a1de7e0f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:48.024240 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-423d035f-3a4e-4408-8519-c2c4a1de7e0f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:48.040222 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-423d035f-3a4e-4408-8519-c2c4a1de7e0f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Getting quotas for project 8ac4f28c68b8487191e2129b9764168c. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 00:59:48.044123 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-423d035f-3a4e-4408-8519-c2c4a1de7e0f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Getting quotas for user 1e102510ea4043db92408769929a2884 and project 8ac4f28c68b8487191e2129b9764168c. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 00:59:48.054556 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-423d035f-3a4e-4408-8519-c2c4a1de7e0f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Going to run 1 instances... {{(pid=127863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 00:59:48.056907 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-423d035f-3a4e-4408-8519-c2c4a1de7e0f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fe09c59-2ff9-4639-b39d-9a474e83ad91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 00:59:48.103089 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-423d035f-3a4e-4408-8519-c2c4a1de7e0f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709768 Jan 28 00:59:48.103774 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 480/987] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 00:59:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 00:59:48.113777 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-05aaaf3a-d3d6-4ff2-a273-e2c5e0c5cb68 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:48.114394 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-05aaaf3a-d3d6-4ff2-a273-e2c5e0c5cb68 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:48.166793 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-05aaaf3a-d3d6-4ff2-a273-e2c5e0c5cb68 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:48.173930 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-05aaaf3a-d3d6-4ff2-a273-e2c5e0c5cb68 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3" status: 200 len: 1218 microversion: 2.1 time: 0.063859 Jan 28 00:59:48.174510 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 508/988] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:48 2022] GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:48.906039 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-01ccae82-0bea-4f76-80eb-26f0cca7d0ed tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:48.906731 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-01ccae82-0bea-4f76-80eb-26f0cca7d0ed tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:48.913154 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-01ccae82-0bea-4f76-80eb-26f0cca7d0ed tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:48.913608 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-01ccae82-0bea-4f76-80eb-26f0cca7d0ed tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:48.914415 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-01ccae82-0bea-4f76-80eb-26f0cca7d0ed tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:48.914887 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-01ccae82-0bea-4f76-80eb-26f0cca7d0ed tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:49.062472 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-01ccae82-0bea-4f76-80eb-26f0cca7d0ed tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:49.071789 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-01ccae82-0bea-4f76-80eb-26f0cca7d0ed tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:49.073321 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-01ccae82-0bea-4f76-80eb-26f0cca7d0ed tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:49.074510 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-01ccae82-0bea-4f76-80eb-26f0cca7d0ed tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1724 microversion: 2.20 time: 0.177400 Jan 28 00:59:49.075085 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 481/989] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:48 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:59:49.190931 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-8a336932-c438-468f-bc0f-5fac2b1a96f1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:49.191633 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-8a336932-c438-468f-bc0f-5fac2b1a96f1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:49.199454 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8a336932-c438-468f-bc0f-5fac2b1a96f1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:49.199913 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8a336932-c438-468f-bc0f-5fac2b1a96f1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:49.200778 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8a336932-c438-468f-bc0f-5fac2b1a96f1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:49.201226 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8a336932-c438-468f-bc0f-5fac2b1a96f1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:49.269672 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-8a336932-c438-468f-bc0f-5fac2b1a96f1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:49.284242 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-8a336932-c438-468f-bc0f-5fac2b1a96f1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3" status: 200 len: 1278 microversion: 2.1 time: 0.096554 Jan 28 00:59:49.285733 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 509/990] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:49 2022] GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3 => generated 1278 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:50.093364 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d1776d2b-bd0e-4cd6-b439-0fa0e879dc92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:50.094690 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d1776d2b-bd0e-4cd6-b439-0fa0e879dc92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:50.102837 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d1776d2b-bd0e-4cd6-b439-0fa0e879dc92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:50.103618 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d1776d2b-bd0e-4cd6-b439-0fa0e879dc92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:50.104683 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d1776d2b-bd0e-4cd6-b439-0fa0e879dc92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:50.105130 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d1776d2b-bd0e-4cd6-b439-0fa0e879dc92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:50.307830 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-634c8ea4-58db-4c60-9086-cba7b8ca7079 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:50.310238 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-634c8ea4-58db-4c60-9086-cba7b8ca7079 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:50.324608 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-634c8ea4-58db-4c60-9086-cba7b8ca7079 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:50.325111 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-634c8ea4-58db-4c60-9086-cba7b8ca7079 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:50.326410 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-634c8ea4-58db-4c60-9086-cba7b8ca7079 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:50.327074 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-634c8ea4-58db-4c60-9086-cba7b8ca7079 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:50.413469 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d1776d2b-bd0e-4cd6-b439-0fa0e879dc92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:50.428282 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d1776d2b-bd0e-4cd6-b439-0fa0e879dc92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:50.431489 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d1776d2b-bd0e-4cd6-b439-0fa0e879dc92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:50.433228 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d1776d2b-bd0e-4cd6-b439-0fa0e879dc92 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1724 microversion: 2.20 time: 0.344219 Jan 28 00:59:50.434396 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 482/991] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:50 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1724 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 00:59:50.607447 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-634c8ea4-58db-4c60-9086-cba7b8ca7079 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:50.623219 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-634c8ea4-58db-4c60-9086-cba7b8ca7079 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3" status: 200 len: 1318 microversion: 2.1 time: 0.321443 Jan 28 00:59:50.624364 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 510/992] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:50 2022] GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:50.900983 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-357f34f6-2fe6-4f0c-9d39-5e49cf868720 req-7d4e2301-b871-4cbe-ab96-5baa6b3a2498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449f7a22-44b6-4b73-97ae-5e6103c1f90e", "name": "network-vif-deleted", "tag": "3c8d8372-3e6d-4edb-96a4-9c2255946417"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:50.903390 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:59:50.903390 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:59:50.918343 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-357f34f6-2fe6-4f0c-9d39-5e49cf868720 req-7d4e2301-b871-4cbe-ab96-5baa6b3a2498 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:50.918925 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-357f34f6-2fe6-4f0c-9d39-5e49cf868720 req-7d4e2301-b871-4cbe-ab96-5baa6b3a2498 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:50.944539 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-357f34f6-2fe6-4f0c-9d39-5e49cf868720 req-7d4e2301-b871-4cbe-ab96-5baa6b3a2498 service nova] Creating event network-vif-deleted:3c8d8372-3e6d-4edb-96a4-9c2255946417 for instance 449f7a22-44b6-4b73-97ae-5e6103c1f90e on hv-cinder-80952 Jan 28 00:59:50.955149 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-357f34f6-2fe6-4f0c-9d39-5e49cf868720 req-7d4e2301-b871-4cbe-ab96-5baa6b3a2498 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057731 Jan 28 00:59:50.956292 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 483/993] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:59:51.048215 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-50d0694c-b3a3-4764-ac57-525d0004a48b req-39a31069-1917-43ff-b559-f3461291a967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1a65c64-c2b0-41aa-94f9-733eb4541ba3", "tag": "5b314c89-8ba0-445e-a18e-60ea472b1470"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:51.049928 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:59:51.049928 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 00:59:51.067516 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-50d0694c-b3a3-4764-ac57-525d0004a48b req-39a31069-1917-43ff-b559-f3461291a967 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:51.067975 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-50d0694c-b3a3-4764-ac57-525d0004a48b req-39a31069-1917-43ff-b559-f3461291a967 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:51.088780 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-50d0694c-b3a3-4764-ac57-525d0004a48b req-39a31069-1917-43ff-b559-f3461291a967 service nova] Creating event network-changed:5b314c89-8ba0-445e-a18e-60ea472b1470 for instance e1a65c64-c2b0-41aa-94f9-733eb4541ba3 on hv-cinder-80952 Jan 28 00:59:51.097899 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-50d0694c-b3a3-4764-ac57-525d0004a48b req-39a31069-1917-43ff-b559-f3461291a967 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053725 Jan 28 00:59:51.098993 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 511/994] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 00:59:51.456508 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-631c8a98-b35a-411a-8416-0c37dd91eb7b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:51.457279 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-631c8a98-b35a-411a-8416-0c37dd91eb7b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:51.468689 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-631c8a98-b35a-411a-8416-0c37dd91eb7b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:51.469850 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-631c8a98-b35a-411a-8416-0c37dd91eb7b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:51.471079 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-631c8a98-b35a-411a-8416-0c37dd91eb7b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:51.471647 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-631c8a98-b35a-411a-8416-0c37dd91eb7b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:51.522544 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-631c8a98-b35a-411a-8416-0c37dd91eb7b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:51.523375 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-631c8a98-b35a-411a-8416-0c37dd91eb7b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:51.524447 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.objects.instance [None req-631c8a98-b35a-411a-8416-0c37dd91eb7b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lazy-loading 'fault' on Instance uuid 449f7a22-44b6-4b73-97ae-5e6103c1f90e {{(pid=127863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 00:59:51.596706 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-631c8a98-b35a-411a-8416-0c37dd91eb7b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:51.609475 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-631c8a98-b35a-411a-8416-0c37dd91eb7b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:51.610802 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-631c8a98-b35a-411a-8416-0c37dd91eb7b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec5dffa23e574a9e97867c93c033fcdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6db84ca9b72548269154e343a33767b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:51.612407 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-631c8a98-b35a-411a-8416-0c37dd91eb7b tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 200 len: 1371 microversion: 2.20 time: 0.162695 Jan 28 00:59:51.625538 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 484/995] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:51 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 00:59:51.652132 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ae899820-b0db-41d2-bcb6-cce9f21d9832 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:51.654742 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ae899820-b0db-41d2-bcb6-cce9f21d9832 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:51.667251 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ae899820-b0db-41d2-bcb6-cce9f21d9832 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:51.671915 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ae899820-b0db-41d2-bcb6-cce9f21d9832 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:51.671915 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ae899820-b0db-41d2-bcb6-cce9f21d9832 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:51.672582 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ae899820-b0db-41d2-bcb6-cce9f21d9832 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:51.880781 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ae899820-b0db-41d2-bcb6-cce9f21d9832 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:51.890190 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ae899820-b0db-41d2-bcb6-cce9f21d9832 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3" status: 200 len: 1318 microversion: 2.1 time: 0.246688 Jan 28 00:59:51.891130 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 512/996] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:51 2022] GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:52.631896 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-6674eeb3-c543-4135-9e42-b8d4d528b367 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:52.632519 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-6674eeb3-c543-4135-9e42-b8d4d528b367 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:52.639242 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6674eeb3-c543-4135-9e42-b8d4d528b367 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:52.639740 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6674eeb3-c543-4135-9e42-b8d4d528b367 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:52.640544 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6674eeb3-c543-4135-9e42-b8d4d528b367 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:52.640992 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6674eeb3-c543-4135-9e42-b8d4d528b367 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:52.655519 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-6674eeb3-c543-4135-9e42-b8d4d528b367 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] HTTP exception thrown: Instance 449f7a22-44b6-4b73-97ae-5e6103c1f90e could not be found. Jan 28 00:59:52.656120 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-6674eeb3-c543-4135-9e42-b8d4d528b367 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Returning 404 to user: Instance 449f7a22-44b6-4b73-97ae-5e6103c1f90e could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:59:52.656963 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-6674eeb3-c543-4135-9e42-b8d4d528b367 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 404 len: 111 microversion: 2.20 time: 0.028933 Jan 28 00:59:52.657520 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 485/997] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:52 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 00:59:52.665924 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f809e9f2-9a13-47b7-8cee-69e9004f0ad9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '.version_select at 0x7fbbc23299d0>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:52.685455 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f809e9f2-9a13-47b7-8cee-69e9004f0ad9 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1173344140" status: 204 len: 0 microversion: 2.20 time: 0.022981 Jan 28 00:59:52.686053 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 513/998] 10.222.0.25 () {60 vars in 1261 bytes} [Fri Jan 28 00:59:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1173344140 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 00:59:52.909690 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ffef761a-d8ee-4a18-a405-bf32619154b9 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:52.910574 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ffef761a-d8ee-4a18-a405-bf32619154b9 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:52.918810 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ffef761a-d8ee-4a18-a405-bf32619154b9 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:52.919964 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ffef761a-d8ee-4a18-a405-bf32619154b9 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:52.921250 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ffef761a-d8ee-4a18-a405-bf32619154b9 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:52.921700 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ffef761a-d8ee-4a18-a405-bf32619154b9 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:53.147453 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-ffef761a-d8ee-4a18-a405-bf32619154b9 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:53.155471 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ffef761a-d8ee-4a18-a405-bf32619154b9 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3" status: 200 len: 1318 microversion: 2.1 time: 0.250702 Jan 28 00:59:53.156062 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 486/999] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:52 2022] GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:54.174519 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-188729fe-6332-40a0-a5c2-b7ce5887dcdc tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:54.175230 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-188729fe-6332-40a0-a5c2-b7ce5887dcdc tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:54.182954 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-188729fe-6332-40a0-a5c2-b7ce5887dcdc tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:54.183454 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-188729fe-6332-40a0-a5c2-b7ce5887dcdc tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:54.184291 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-188729fe-6332-40a0-a5c2-b7ce5887dcdc tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:54.184741 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-188729fe-6332-40a0-a5c2-b7ce5887dcdc tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:54.347738 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-188729fe-6332-40a0-a5c2-b7ce5887dcdc tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:54.356157 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-188729fe-6332-40a0-a5c2-b7ce5887dcdc tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3" status: 200 len: 1318 microversion: 2.1 time: 0.186744 Jan 28 00:59:54.356761 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 514/1000] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:54 2022] GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:54.634963 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ad0f9cd1-96d8-41e6-b634-7aee3f082352 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:54.635600 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ad0f9cd1-96d8-41e6-b634-7aee3f082352 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:54.643409 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ad0f9cd1-96d8-41e6-b634-7aee3f082352 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:54.644138 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ad0f9cd1-96d8-41e6-b634-7aee3f082352 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:54.644936 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ad0f9cd1-96d8-41e6-b634-7aee3f082352 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:54.645376 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ad0f9cd1-96d8-41e6-b634-7aee3f082352 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:54.661233 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-ad0f9cd1-96d8-41e6-b634-7aee3f082352 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] HTTP exception thrown: Instance 449f7a22-44b6-4b73-97ae-5e6103c1f90e could not be found. Jan 28 00:59:54.661835 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ad0f9cd1-96d8-41e6-b634-7aee3f082352 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Returning 404 to user: Instance 449f7a22-44b6-4b73-97ae-5e6103c1f90e could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:59:54.662681 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ad0f9cd1-96d8-41e6-b634-7aee3f082352 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "DELETE /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 404 len: 111 microversion: 2.20 time: 0.031515 Jan 28 00:59:54.663245 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 487/1001] 10.222.0.25 () {60 vars in 1279 bytes} [Fri Jan 28 00:59:54 2022] DELETE /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 00:59:54.673193 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-599001e0-a338-4e47-b9a7-1c3e8dcd0879 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:54.674129 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-599001e0-a338-4e47-b9a7-1c3e8dcd0879 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 449f7a22-44b6-4b73-97ae-5e6103c1f90e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:54.681002 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-599001e0-a338-4e47-b9a7-1c3e8dcd0879 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:54.681467 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-599001e0-a338-4e47-b9a7-1c3e8dcd0879 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:54.682289 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-599001e0-a338-4e47-b9a7-1c3e8dcd0879 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:54.682739 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-599001e0-a338-4e47-b9a7-1c3e8dcd0879 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:54.698087 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-599001e0-a338-4e47-b9a7-1c3e8dcd0879 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] HTTP exception thrown: Instance 449f7a22-44b6-4b73-97ae-5e6103c1f90e could not be found. Jan 28 00:59:54.698648 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-599001e0-a338-4e47-b9a7-1c3e8dcd0879 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Returning 404 to user: Instance 449f7a22-44b6-4b73-97ae-5e6103c1f90e could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:59:54.699542 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-599001e0-a338-4e47-b9a7-1c3e8dcd0879 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e" status: 404 len: 111 microversion: 2.20 time: 0.031524 Jan 28 00:59:54.700124 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 515/1002] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:54 2022] GET /compute/v2.1/servers/449f7a22-44b6-4b73-97ae-5e6103c1f90e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 28 00:59:55.374742 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d38d2a55-8a10-4b90-ac3f-4aa61466e1a3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:55.375280 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d38d2a55-8a10-4b90-ac3f-4aa61466e1a3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:55.385021 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d38d2a55-8a10-4b90-ac3f-4aa61466e1a3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:55.385695 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d38d2a55-8a10-4b90-ac3f-4aa61466e1a3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:55.386726 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d38d2a55-8a10-4b90-ac3f-4aa61466e1a3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:55.387259 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d38d2a55-8a10-4b90-ac3f-4aa61466e1a3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:55.527517 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d38d2a55-8a10-4b90-ac3f-4aa61466e1a3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:55.535958 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d38d2a55-8a10-4b90-ac3f-4aa61466e1a3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3" status: 200 len: 1318 microversion: 2.1 time: 0.165670 Jan 28 00:59:55.536542 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 488/1003] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:55 2022] GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 00:59:55.845984 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-2254f11b-3f13-4508-b089-0530f49e0537 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:55.846650 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-2254f11b-3f13-4508-b089-0530f49e0537 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:55.853486 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2254f11b-3f13-4508-b089-0530f49e0537 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:55.854027 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2254f11b-3f13-4508-b089-0530f49e0537 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:55.854980 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2254f11b-3f13-4508-b089-0530f49e0537 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:55.855587 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2254f11b-3f13-4508-b089-0530f49e0537 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:55.871330 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-2254f11b-3f13-4508-b089-0530f49e0537 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] HTTP exception thrown: Instance 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 could not be found. Jan 28 00:59:55.871944 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-2254f11b-3f13-4508-b089-0530f49e0537 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Returning 404 to user: Instance 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:59:55.872870 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-2254f11b-3f13-4508-b089-0530f49e0537 tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "DELETE /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 404 len: 111 microversion: 2.20 time: 0.031852 Jan 28 00:59:55.873422 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 516/1004] 10.222.0.25 () {60 vars in 1279 bytes} [Fri Jan 28 00:59:55 2022] DELETE /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 00:59:55.881893 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a421ab4a-8c12-49a5-945e-f2484418a97d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:55.882507 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a421ab4a-8c12-49a5-945e-f2484418a97d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] [instance: 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:55.890068 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a421ab4a-8c12-49a5-945e-f2484418a97d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:55.890531 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a421ab4a-8c12-49a5-945e-f2484418a97d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:55.891416 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a421ab4a-8c12-49a5-945e-f2484418a97d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:55.891943 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a421ab4a-8c12-49a5-945e-f2484418a97d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:55.908152 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-a421ab4a-8c12-49a5-945e-f2484418a97d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] HTTP exception thrown: Instance 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 could not be found. Jan 28 00:59:55.908826 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a421ab4a-8c12-49a5-945e-f2484418a97d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] Returning 404 to user: Instance 18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 00:59:55.909780 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a421ab4a-8c12-49a5-945e-f2484418a97d tempest-AttachVolumeShelveTestJSON-1082611847 tempest-AttachVolumeShelveTestJSON-1082611847-project] 10.222.0.25 "GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4" status: 404 len: 111 microversion: 2.20 time: 0.031944 Jan 28 00:59:55.910436 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 489/1005] 10.222.0.25 () {60 vars in 1276 bytes} [Fri Jan 28 00:59:55 2022] GET /compute/v2.1/servers/18e4e05f-2d59-4c9b-8aa1-fc1a276e27e4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 00:59:56.554259 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-b8d06ac3-ab46-4c8e-94b9-e0dd4ff478b7 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:56.555019 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-b8d06ac3-ab46-4c8e-94b9-e0dd4ff478b7 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:56.562724 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b8d06ac3-ab46-4c8e-94b9-e0dd4ff478b7 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:56.563316 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b8d06ac3-ab46-4c8e-94b9-e0dd4ff478b7 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:56.564293 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b8d06ac3-ab46-4c8e-94b9-e0dd4ff478b7 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:56.564819 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b8d06ac3-ab46-4c8e-94b9-e0dd4ff478b7 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:56.575457 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-a15b3ea0-c2b9-4b60-8bca-b5f5adcba5c2 req-a7ae8dec-0561-4577-bb1d-1f9fcf5d54c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a65c64-c2b0-41aa-94f9-733eb4541ba3", "name": "network-vif-plugged", "status": "completed", "tag": "5b314c89-8ba0-445e-a18e-60ea472b1470"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 00:59:56.577945 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 00:59:56.577945 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 00:59:56.585829 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-a15b3ea0-c2b9-4b60-8bca-b5f5adcba5c2 req-a7ae8dec-0561-4577-bb1d-1f9fcf5d54c5 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:56.586267 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-a15b3ea0-c2b9-4b60-8bca-b5f5adcba5c2 req-a7ae8dec-0561-4577-bb1d-1f9fcf5d54c5 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:56.615452 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-a15b3ea0-c2b9-4b60-8bca-b5f5adcba5c2 req-a7ae8dec-0561-4577-bb1d-1f9fcf5d54c5 service nova] Creating event network-vif-plugged:5b314c89-8ba0-445e-a18e-60ea472b1470 for instance e1a65c64-c2b0-41aa-94f9-733eb4541ba3 on hv-cinder-80952 Jan 28 00:59:56.626435 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-a15b3ea0-c2b9-4b60-8bca-b5f5adcba5c2 req-a7ae8dec-0561-4577-bb1d-1f9fcf5d54c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054111 Jan 28 00:59:56.627530 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 490/1006] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 00:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 00:59:56.838434 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-b8d06ac3-ab46-4c8e-94b9-e0dd4ff478b7 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:56.847815 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-b8d06ac3-ab46-4c8e-94b9-e0dd4ff478b7 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3" status: 200 len: 1318 microversion: 2.1 time: 0.297229 Jan 28 00:59:56.848781 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 517/1007] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:56 2022] GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:57.870595 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d7a1560d-3673-47bc-93fd-bf69a1950084 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:57.871928 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d7a1560d-3673-47bc-93fd-bf69a1950084 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:57.884678 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d7a1560d-3673-47bc-93fd-bf69a1950084 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:57.885474 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d7a1560d-3673-47bc-93fd-bf69a1950084 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:57.886962 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d7a1560d-3673-47bc-93fd-bf69a1950084 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:57.887779 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d7a1560d-3673-47bc-93fd-bf69a1950084 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:58.412800 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d7a1560d-3673-47bc-93fd-bf69a1950084 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:58.426345 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d7a1560d-3673-47bc-93fd-bf69a1950084 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3" status: 200 len: 1318 microversion: 2.1 time: 0.563012 Jan 28 00:59:58.428452 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 491/1008] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:57 2022] GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3 => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 00:59:59.445207 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-95d36b83-ffbc-4c7b-acc6-18cebfa6128d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 00:59:59.446188 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-95d36b83-ffbc-4c7b-acc6-18cebfa6128d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 00:59:59.453707 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-95d36b83-ffbc-4c7b-acc6-18cebfa6128d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:59.454343 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-95d36b83-ffbc-4c7b-acc6-18cebfa6128d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:59.455371 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-95d36b83-ffbc-4c7b-acc6-18cebfa6128d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 00:59:59.455945 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-95d36b83-ffbc-4c7b-acc6-18cebfa6128d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 00:59:59.661650 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-95d36b83-ffbc-4c7b-acc6-18cebfa6128d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 00:59:59.674822 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-95d36b83-ffbc-4c7b-acc6-18cebfa6128d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3" status: 200 len: 1508 microversion: 2.1 time: 0.232889 Jan 28 00:59:59.676143 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 518/1009] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 00:59:59 2022] GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3 => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:01.144372 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2e37d66f-96d3-4283-aa66-00ef3f7ecbb0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1fd853c-3c8b-4666-b5e4-d6c35d1733cb"}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:01.145568 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2e37d66f-96d3-4283-aa66-00ef3f7ecbb0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:01.152966 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2e37d66f-96d3-4283-aa66-00ef3f7ecbb0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:01.153421 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2e37d66f-96d3-4283-aa66-00ef3f7ecbb0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:01.154943 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2e37d66f-96d3-4283-aa66-00ef3f7ecbb0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:01.155418 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2e37d66f-96d3-4283-aa66-00ef3f7ecbb0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:01.296822 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-bd2ff0b4-2e5d-4ac6-8f13-33c862907b05 tempest-VolumesGetTestJSON-41471756 tempest-VolumesGetTestJSON-41471756-project] Action: 'create', calling method: .version_select at 0x7fbbc2422670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1182400177", "metadata": {"Type": "work"}}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:01.478502 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2e37d66f-96d3-4283-aa66-00ef3f7ecbb0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "POST /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337990 Jan 28 01:00:01.479435 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 492/1010] 10.222.0.25 () {60 vars in 1322 bytes} [Fri Jan 28 01:00:01 2022] POST /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:00:01.640409 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-bd2ff0b4-2e5d-4ac6-8f13-33c862907b05 tempest-VolumesGetTestJSON-41471756 tempest-VolumesGetTestJSON-41471756-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.500003 Jan 28 01:00:01.641189 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 519/1011] 10.222.0.25 () {60 vars in 1155 bytes} [Fri Jan 28 01:00:01 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 501 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jan 28 01:00:01.654184 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1359563d-7c26-4704-aca2-5fd2bb88161a tempest-VolumesGetTestJSON-41471756 tempest-VolumesGetTestJSON-41471756-project] Calling method '.version_select at 0x7fbbc25969d0>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:01.715416 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1359563d-7c26-4704-aca2-5fd2bb88161a tempest-VolumesGetTestJSON-41471756 tempest-VolumesGetTestJSON-41471756-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/709122b2-573d-4d6d-80ec-21a13e134695" status: 200 len: 353 microversion: 2.1 time: 0.065101 Jan 28 01:00:01.716055 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 493/1012] 10.222.0.25 () {58 vars in 1244 bytes} [Fri Jan 28 01:00:01 2022] GET /compute/v2.1/os-volumes/709122b2-573d-4d6d-80ec-21a13e134695 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:00:02.729979 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-125f1490-051d-4c9b-bc93-100f33c96582 tempest-VolumesGetTestJSON-41471756 tempest-VolumesGetTestJSON-41471756-project] Calling method '.version_select at 0x7fbbc24f89d0>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:02.782053 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-125f1490-051d-4c9b-bc93-100f33c96582 tempest-VolumesGetTestJSON-41471756 tempest-VolumesGetTestJSON-41471756-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/709122b2-573d-4d6d-80ec-21a13e134695" status: 200 len: 354 microversion: 2.1 time: 0.056991 Jan 28 01:00:02.782630 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 520/1013] 10.222.0.25 () {58 vars in 1244 bytes} [Fri Jan 28 01:00:02 2022] GET /compute/v2.1/os-volumes/709122b2-573d-4d6d-80ec-21a13e134695 => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:00:02.793844 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-50b5e792-ac0e-42a1-8d85-29d84734ecb6 tempest-VolumesGetTestJSON-41471756 tempest-VolumesGetTestJSON-41471756-project] Calling method '.version_select at 0x7fbbc24c0a60>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:02.843235 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-50b5e792-ac0e-42a1-8d85-29d84734ecb6 tempest-VolumesGetTestJSON-41471756 tempest-VolumesGetTestJSON-41471756-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/709122b2-573d-4d6d-80ec-21a13e134695" status: 200 len: 354 microversion: 2.1 time: 0.053617 Jan 28 01:00:02.843827 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 494/1014] 10.222.0.25 () {58 vars in 1244 bytes} [Fri Jan 28 01:00:02 2022] GET /compute/v2.1/os-volumes/709122b2-573d-4d6d-80ec-21a13e134695 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:00:02.860029 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-906b66e6-8d3e-456b-950b-5d049bf1cc66 tempest-VolumesGetTestJSON-41471756 tempest-VolumesGetTestJSON-41471756-project] Calling method '.version_select at 0x7fbbc21248b0>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:02.923877 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-906b66e6-8d3e-456b-950b-5d049bf1cc66 tempest-VolumesGetTestJSON-41471756 tempest-VolumesGetTestJSON-41471756-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/709122b2-573d-4d6d-80ec-21a13e134695" status: 202 len: 0 microversion: 2.1 time: 0.068011 Jan 28 01:00:02.924540 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 521/1015] 10.222.0.25 () {58 vars in 1247 bytes} [Fri Jan 28 01:00:02 2022] DELETE /compute/v2.1/os-volumes/709122b2-573d-4d6d-80ec-21a13e134695 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:00:02.932237 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e5555097-9ba9-47e4-94ad-1c25296c8f95 tempest-VolumesGetTestJSON-41471756 tempest-VolumesGetTestJSON-41471756-project] Calling method '.version_select at 0x7fbbc2596310>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:02.980710 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e5555097-9ba9-47e4-94ad-1c25296c8f95 tempest-VolumesGetTestJSON-41471756 tempest-VolumesGetTestJSON-41471756-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/709122b2-573d-4d6d-80ec-21a13e134695" status: 200 len: 353 microversion: 2.1 time: 0.051998 Jan 28 01:00:02.981303 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 495/1016] 10.222.0.25 () {58 vars in 1244 bytes} [Fri Jan 28 01:00:02 2022] GET /compute/v2.1/os-volumes/709122b2-573d-4d6d-80ec-21a13e134695 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:00:03.993930 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-335d8bfa-072e-4c98-8b4b-4dffa7cb1cca tempest-VolumesGetTestJSON-41471756 tempest-VolumesGetTestJSON-41471756-project] Calling method '.version_select at 0x7fbbc2677b80>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:04.021510 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-335d8bfa-072e-4c98-8b4b-4dffa7cb1cca tempest-VolumesGetTestJSON-41471756 tempest-VolumesGetTestJSON-41471756-project] HTTP exception thrown: Volume 709122b2-573d-4d6d-80ec-21a13e134695 could not be found. Jan 28 01:00:04.022122 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-335d8bfa-072e-4c98-8b4b-4dffa7cb1cca tempest-VolumesGetTestJSON-41471756 tempest-VolumesGetTestJSON-41471756-project] Returning 404 to user: Volume 709122b2-573d-4d6d-80ec-21a13e134695 could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:00:04.022973 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-335d8bfa-072e-4c98-8b4b-4dffa7cb1cca tempest-VolumesGetTestJSON-41471756 tempest-VolumesGetTestJSON-41471756-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/709122b2-573d-4d6d-80ec-21a13e134695" status: 404 len: 109 microversion: 2.1 time: 0.033384 Jan 28 01:00:04.023561 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 522/1017] 10.222.0.25 () {58 vars in 1244 bytes} [Fri Jan 28 01:00:03 2022] GET /compute/v2.1/os-volumes/709122b2-573d-4d6d-80ec-21a13e134695 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:00:10.266647 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-83d0765f-8286-4222-969b-d1f5219fcc3f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1883600960", "imageRef": "7fe09c59-2ff9-4639-b39d-9a474e83ad91", "flavorRef": "452", "networks": [{"uuid": "24e25033-acbb-46d6-9923-f2b3f53599d8"}]}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:10.331009 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.network.neutron [None req-83d0765f-8286-4222-969b-d1f5219fcc3f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] validate_networks() for [('24e25033-acbb-46d6-9923-f2b3f53599d8', None, None, None, None, None)] {{(pid=127863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:00:10.845525 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-83d0765f-8286-4222-969b-d1f5219fcc3f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Flavor limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:00:10.846125 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-83d0765f-8286-4222-969b-d1f5219fcc3f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Image limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:00:10.846952 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-83d0765f-8286-4222-969b-d1f5219fcc3f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Flavor pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:00:10.848168 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-83d0765f-8286-4222-969b-d1f5219fcc3f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Image pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:00:10.848922 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-83d0765f-8286-4222-969b-d1f5219fcc3f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:00:10.864842 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-83d0765f-8286-4222-969b-d1f5219fcc3f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:10.865696 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-83d0765f-8286-4222-969b-d1f5219fcc3f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:10.866736 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-83d0765f-8286-4222-969b-d1f5219fcc3f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:10.867634 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-83d0765f-8286-4222-969b-d1f5219fcc3f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:10.898287 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-83d0765f-8286-4222-969b-d1f5219fcc3f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Getting quotas for project 8ac4f28c68b8487191e2129b9764168c. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:00:10.903611 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-83d0765f-8286-4222-969b-d1f5219fcc3f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Getting quotas for user 1e102510ea4043db92408769929a2884 and project 8ac4f28c68b8487191e2129b9764168c. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:00:10.917947 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-83d0765f-8286-4222-969b-d1f5219fcc3f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Going to run 1 instances... {{(pid=127863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:00:10.921314 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-83d0765f-8286-4222-969b-d1f5219fcc3f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: efac69d4-1999-4729-a1f5-2242cc25f097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fe09c59-2ff9-4639-b39d-9a474e83ad91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:00:10.973329 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-83d0765f-8286-4222-969b-d1f5219fcc3f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715459 Jan 28 01:00:10.979034 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 496/1018] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 01:00:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:00:10.990315 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-88865366-8248-4328-9500-fae795193cd1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:10.993261 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-88865366-8248-4328-9500-fae795193cd1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: efac69d4-1999-4729-a1f5-2242cc25f097] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:11.091526 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-88865366-8248-4328-9500-fae795193cd1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:11.102551 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-88865366-8248-4328-9500-fae795193cd1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097" status: 200 len: 1218 microversion: 2.1 time: 0.121199 Jan 28 01:00:11.103926 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 523/1019] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:10 2022] GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097 => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:12.122152 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-d60ac731-1151-4a86-b568-60b4e6d718eb tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:12.123581 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-d60ac731-1151-4a86-b568-60b4e6d718eb tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: efac69d4-1999-4729-a1f5-2242cc25f097] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:12.136437 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d60ac731-1151-4a86-b568-60b4e6d718eb tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:12.137338 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d60ac731-1151-4a86-b568-60b4e6d718eb tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:12.139190 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d60ac731-1151-4a86-b568-60b4e6d718eb tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:12.140088 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-d60ac731-1151-4a86-b568-60b4e6d718eb tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:12.240779 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-d60ac731-1151-4a86-b568-60b4e6d718eb tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:12.252515 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-d60ac731-1151-4a86-b568-60b4e6d718eb tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097" status: 200 len: 1270 microversion: 2.1 time: 0.135565 Jan 28 01:00:12.253424 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 497/1020] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:12 2022] GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097 => generated 1270 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:13.275163 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-575f5ce6-7204-4753-bf42-95ba734b10c4 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:13.276745 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-575f5ce6-7204-4753-bf42-95ba734b10c4 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: efac69d4-1999-4729-a1f5-2242cc25f097] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:13.287473 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-575f5ce6-7204-4753-bf42-95ba734b10c4 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:13.288313 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-575f5ce6-7204-4753-bf42-95ba734b10c4 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:13.289975 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-575f5ce6-7204-4753-bf42-95ba734b10c4 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:13.291073 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-575f5ce6-7204-4753-bf42-95ba734b10c4 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:13.400074 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-575f5ce6-7204-4753-bf42-95ba734b10c4 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:13.411058 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-575f5ce6-7204-4753-bf42-95ba734b10c4 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097" status: 200 len: 1276 microversion: 2.1 time: 0.143103 Jan 28 01:00:13.412199 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 524/1021] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:13 2022] GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097 => generated 1276 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:13.842873 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-723ae05a-7d06-42b1-b8b4-a1c19424fb99 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1331286466", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2038861869", "security_groups": [{"name": "tempest-secgroup-smoke-726777567"}], "block_device_mapping_v2": [{"uuid": "41daf81b-2e53-4621-b84b-baff28f0c1b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "30aa1d90-fbc0-4d47-a9cd-dbadcfadc4e7"}]}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:13.991792 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.network.neutron [None req-723ae05a-7d06-42b1-b8b4-a1c19424fb99 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] validate_networks() for [('30aa1d90-fbc0-4d47-a9cd-dbadcfadc4e7', None, None, None, None, None)] {{(pid=127863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:00:14.438314 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-89e208f4-dbc8-4fe5-852c-33e15b68d536 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:14.439690 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-89e208f4-dbc8-4fe5-852c-33e15b68d536 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: efac69d4-1999-4729-a1f5-2242cc25f097] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:14.448270 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-89e208f4-dbc8-4fe5-852c-33e15b68d536 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:14.449042 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-89e208f4-dbc8-4fe5-852c-33e15b68d536 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:14.450137 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-89e208f4-dbc8-4fe5-852c-33e15b68d536 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:14.450900 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-89e208f4-dbc8-4fe5-852c-33e15b68d536 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:14.790638 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-723ae05a-7d06-42b1-b8b4-a1c19424fb99 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Flavor limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:00:14.791650 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-723ae05a-7d06-42b1-b8b4-a1c19424fb99 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Image limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:00:14.792646 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-723ae05a-7d06-42b1-b8b4-a1c19424fb99 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Flavor pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:00:14.793371 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-723ae05a-7d06-42b1-b8b4-a1c19424fb99 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Image pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:00:14.793848 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-723ae05a-7d06-42b1-b8b4-a1c19424fb99 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:00:14.808876 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-723ae05a-7d06-42b1-b8b4-a1c19424fb99 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:14.809693 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-723ae05a-7d06-42b1-b8b4-a1c19424fb99 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:14.811826 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-723ae05a-7d06-42b1-b8b4-a1c19424fb99 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:14.812653 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-723ae05a-7d06-42b1-b8b4-a1c19424fb99 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:14.814288 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-89e208f4-dbc8-4fe5-852c-33e15b68d536 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:14.822957 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-89e208f4-dbc8-4fe5-852c-33e15b68d536 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097" status: 200 len: 1318 microversion: 2.1 time: 0.388870 Jan 28 01:00:14.824040 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 525/1022] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:14 2022] GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:14.829833 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-998aa0e0-fb6f-489a-b19c-bae69fde6f47 req-c25eddb7-f43e-4b93-8784-a479cde6edbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efac69d4-1999-4729-a1f5-2242cc25f097", "tag": "dbf5e345-a1ef-4155-bf0c-8b9b60c3f7c3"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:14.832062 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:00:14.832062 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 01:00:14.839865 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-998aa0e0-fb6f-489a-b19c-bae69fde6f47 req-c25eddb7-f43e-4b93-8784-a479cde6edbb service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:14.840316 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-998aa0e0-fb6f-489a-b19c-bae69fde6f47 req-c25eddb7-f43e-4b93-8784-a479cde6edbb service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:14.847298 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-723ae05a-7d06-42b1-b8b4-a1c19424fb99 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Getting quotas for project dfca2fc1b6c24ac7910c44e6d7936366. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:00:14.854875 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-723ae05a-7d06-42b1-b8b4-a1c19424fb99 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Getting quotas for user 4a973914214249bebd8bd067a8c21ac3 and project dfca2fc1b6c24ac7910c44e6d7936366. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:00:14.855338 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-998aa0e0-fb6f-489a-b19c-bae69fde6f47 req-c25eddb7-f43e-4b93-8784-a479cde6edbb service nova] Creating event network-changed:dbf5e345-a1ef-4155-bf0c-8b9b60c3f7c3 for instance efac69d4-1999-4729-a1f5-2242cc25f097 on hv-cinder-80952 Jan 28 01:00:14.862944 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-998aa0e0-fb6f-489a-b19c-bae69fde6f47 req-c25eddb7-f43e-4b93-8784-a479cde6edbb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037200 Jan 28 01:00:14.864248 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 526/1023] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:00:14.933606 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-723ae05a-7d06-42b1-b8b4-a1c19424fb99 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Going to run 1 instances... {{(pid=127863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:00:14.936080 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-723ae05a-7d06-42b1-b8b4-a1c19424fb99 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='41daf81b-2e53-4621-b84b-baff28f0c1b3',volume_size=None,volume_type=None)] {{(pid=127863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:00:15.085199 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-723ae05a-7d06-42b1-b8b4-a1c19424fb99 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.247091 Jan 28 01:00:15.086240 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 498/1024] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 01:00:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 01:00:15.098817 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7a1525f2-115a-4a57-8fe7-33288e6f1834 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:15.099317 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7a1525f2-115a-4a57-8fe7-33288e6f1834 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:15.174734 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7a1525f2-115a-4a57-8fe7-33288e6f1834 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:15.186768 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7a1525f2-115a-4a57-8fe7-33288e6f1834 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1095 microversion: 2.1 time: 0.091410 Jan 28 01:00:15.187859 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 527/1025] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:15 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1095 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:15.842052 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-49aff779-f4d3-4ccd-90bb-44a11801f5b3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:15.843081 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-49aff779-f4d3-4ccd-90bb-44a11801f5b3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: efac69d4-1999-4729-a1f5-2242cc25f097] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:15.851029 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-49aff779-f4d3-4ccd-90bb-44a11801f5b3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:15.852019 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-49aff779-f4d3-4ccd-90bb-44a11801f5b3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:15.852660 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-49aff779-f4d3-4ccd-90bb-44a11801f5b3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:15.853231 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-49aff779-f4d3-4ccd-90bb-44a11801f5b3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:16.041763 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-49aff779-f4d3-4ccd-90bb-44a11801f5b3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:16.064794 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-49aff779-f4d3-4ccd-90bb-44a11801f5b3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097" status: 200 len: 1318 microversion: 2.1 time: 0.227086 Jan 28 01:00:16.065763 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 499/1026] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:15 2022] GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:16.205273 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-87d7e77f-0b7e-40e9-a48b-6b41ddbafc0c tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:16.205889 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-87d7e77f-0b7e-40e9-a48b-6b41ddbafc0c tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:16.212860 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-87d7e77f-0b7e-40e9-a48b-6b41ddbafc0c tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:16.213318 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-87d7e77f-0b7e-40e9-a48b-6b41ddbafc0c tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:16.214230 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-87d7e77f-0b7e-40e9-a48b-6b41ddbafc0c tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:16.214584 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-87d7e77f-0b7e-40e9-a48b-6b41ddbafc0c tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:16.292861 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-87d7e77f-0b7e-40e9-a48b-6b41ddbafc0c tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:16.304550 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-87d7e77f-0b7e-40e9-a48b-6b41ddbafc0c tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1193 microversion: 2.1 time: 0.103821 Jan 28 01:00:16.305289 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 528/1027] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:16 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1193 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:17.089655 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2471ebfc-eec0-41f1-aa68-214a53971070 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:17.091252 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2471ebfc-eec0-41f1-aa68-214a53971070 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: efac69d4-1999-4729-a1f5-2242cc25f097] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:17.108225 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2471ebfc-eec0-41f1-aa68-214a53971070 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:17.109683 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2471ebfc-eec0-41f1-aa68-214a53971070 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:17.111487 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2471ebfc-eec0-41f1-aa68-214a53971070 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:17.112353 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2471ebfc-eec0-41f1-aa68-214a53971070 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:17.330006 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-6f939821-90e1-4031-b924-af55da15d4c9 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:17.330676 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-6f939821-90e1-4031-b924-af55da15d4c9 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:17.344600 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6f939821-90e1-4031-b924-af55da15d4c9 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:17.344981 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6f939821-90e1-4031-b924-af55da15d4c9 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:17.352685 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6f939821-90e1-4031-b924-af55da15d4c9 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:17.353784 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6f939821-90e1-4031-b924-af55da15d4c9 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:17.404214 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-2471ebfc-eec0-41f1-aa68-214a53971070 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:17.417115 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2471ebfc-eec0-41f1-aa68-214a53971070 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097" status: 200 len: 1318 microversion: 2.1 time: 0.336566 Jan 28 01:00:17.425851 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 500/1028] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:17 2022] GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:17.603867 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-6f939821-90e1-4031-b924-af55da15d4c9 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:17.614409 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-6f939821-90e1-4031-b924-af55da15d4c9 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1278 microversion: 2.1 time: 0.292357 Jan 28 01:00:17.615022 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 529/1029] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:17 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1278 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:18.399183 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-a0908dc7-519a-42e1-b2d4-ebaf5e3996a9 req-5f528ed1-92b8-44c9-87be-8293b909d2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c98be1-6473-4b8f-9c94-12eef8495893", "tag": "fa936154-1bb4-41ee-b929-553ae9ae8f60"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:18.401747 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:00:18.401747 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 01:00:18.410023 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-a0908dc7-519a-42e1-b2d4-ebaf5e3996a9 req-5f528ed1-92b8-44c9-87be-8293b909d2d5 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:18.410487 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-a0908dc7-519a-42e1-b2d4-ebaf5e3996a9 req-5f528ed1-92b8-44c9-87be-8293b909d2d5 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:18.426189 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-a0908dc7-519a-42e1-b2d4-ebaf5e3996a9 req-5f528ed1-92b8-44c9-87be-8293b909d2d5 service nova] Creating event network-changed:fa936154-1bb4-41ee-b929-553ae9ae8f60 for instance 92c98be1-6473-4b8f-9c94-12eef8495893 on hv-cinder-80952 Jan 28 01:00:18.437613 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-a0908dc7-519a-42e1-b2d4-ebaf5e3996a9 req-5f528ed1-92b8-44c9-87be-8293b909d2d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039599 Jan 28 01:00:18.437613 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 501/1030] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:00:18.442662 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3a6adef8-cfdb-4e8c-a38f-a1fc96e16dbd tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:18.443301 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3a6adef8-cfdb-4e8c-a38f-a1fc96e16dbd tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: efac69d4-1999-4729-a1f5-2242cc25f097] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:18.453496 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3a6adef8-cfdb-4e8c-a38f-a1fc96e16dbd tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:18.454004 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3a6adef8-cfdb-4e8c-a38f-a1fc96e16dbd tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:18.454834 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3a6adef8-cfdb-4e8c-a38f-a1fc96e16dbd tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:18.455312 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3a6adef8-cfdb-4e8c-a38f-a1fc96e16dbd tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:18.633349 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-acf344d6-9052-4069-bed6-269a6dc144c4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:18.634342 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-acf344d6-9052-4069-bed6-269a6dc144c4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:18.646357 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-acf344d6-9052-4069-bed6-269a6dc144c4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:18.651888 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-acf344d6-9052-4069-bed6-269a6dc144c4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:18.653458 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-acf344d6-9052-4069-bed6-269a6dc144c4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:18.654220 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-acf344d6-9052-4069-bed6-269a6dc144c4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:18.668177 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3a6adef8-cfdb-4e8c-a38f-a1fc96e16dbd tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:18.713692 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3a6adef8-cfdb-4e8c-a38f-a1fc96e16dbd tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097" status: 200 len: 1318 microversion: 2.1 time: 0.270124 Jan 28 01:00:18.719944 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 530/1031] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:18 2022] GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:18.737719 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-d0bf8069-052c-4bb1-9dd8-7a9a86114951 req-a1e46379-924a-4c12-8786-cae58ee70539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efac69d4-1999-4729-a1f5-2242cc25f097", "name": "network-vif-plugged", "status": "completed", "tag": "dbf5e345-a1ef-4155-bf0c-8b9b60c3f7c3"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:18.745656 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:00:18.745656 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 01:00:18.773166 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-d0bf8069-052c-4bb1-9dd8-7a9a86114951 req-a1e46379-924a-4c12-8786-cae58ee70539 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:18.780239 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-d0bf8069-052c-4bb1-9dd8-7a9a86114951 req-a1e46379-924a-4c12-8786-cae58ee70539 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:18.821474 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-d0bf8069-052c-4bb1-9dd8-7a9a86114951 req-a1e46379-924a-4c12-8786-cae58ee70539 service nova] Creating event network-vif-plugged:dbf5e345-a1ef-4155-bf0c-8b9b60c3f7c3 for instance efac69d4-1999-4729-a1f5-2242cc25f097 on hv-cinder-80952 Jan 28 01:00:18.831250 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-d0bf8069-052c-4bb1-9dd8-7a9a86114951 req-a1e46379-924a-4c12-8786-cae58ee70539 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101995 Jan 28 01:00:18.832475 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 531/1032] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:00:19.002393 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-acf344d6-9052-4069-bed6-269a6dc144c4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:19.012933 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-acf344d6-9052-4069-bed6-269a6dc144c4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1266 microversion: 2.1 time: 0.383452 Jan 28 01:00:19.024175 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 502/1033] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:18 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1266 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:19.739615 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-e65b1515-0586-47d0-b910-84b54629cf91 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:19.741173 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-e65b1515-0586-47d0-b910-84b54629cf91 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: efac69d4-1999-4729-a1f5-2242cc25f097] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:19.750134 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e65b1515-0586-47d0-b910-84b54629cf91 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:19.750134 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e65b1515-0586-47d0-b910-84b54629cf91 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:19.751157 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e65b1515-0586-47d0-b910-84b54629cf91 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:19.751601 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e65b1515-0586-47d0-b910-84b54629cf91 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:19.918041 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-e65b1515-0586-47d0-b910-84b54629cf91 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:19.926583 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-e65b1515-0586-47d0-b910-84b54629cf91 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097" status: 200 len: 1318 microversion: 2.1 time: 0.192831 Jan 28 01:00:19.928274 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 532/1034] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:19 2022] GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:20.046603 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-fcccbe82-2286-40dc-b9d1-78b0ba542bf0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:20.047298 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-fcccbe82-2286-40dc-b9d1-78b0ba542bf0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:20.053785 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fcccbe82-2286-40dc-b9d1-78b0ba542bf0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:20.054250 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fcccbe82-2286-40dc-b9d1-78b0ba542bf0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:20.055199 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fcccbe82-2286-40dc-b9d1-78b0ba542bf0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:20.055665 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fcccbe82-2286-40dc-b9d1-78b0ba542bf0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:20.228465 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-fcccbe82-2286-40dc-b9d1-78b0ba542bf0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:20.237528 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-fcccbe82-2286-40dc-b9d1-78b0ba542bf0 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1266 microversion: 2.1 time: 0.198725 Jan 28 01:00:20.238106 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 503/1035] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:20 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:20.948441 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-79af09fa-d891-4895-9f8e-5b5ce6aa360b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:20.949266 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-79af09fa-d891-4895-9f8e-5b5ce6aa360b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: efac69d4-1999-4729-a1f5-2242cc25f097] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:20.958803 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-79af09fa-d891-4895-9f8e-5b5ce6aa360b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:20.959415 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-79af09fa-d891-4895-9f8e-5b5ce6aa360b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:20.960404 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-79af09fa-d891-4895-9f8e-5b5ce6aa360b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:20.960976 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-79af09fa-d891-4895-9f8e-5b5ce6aa360b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:21.099307 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-79af09fa-d891-4895-9f8e-5b5ce6aa360b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:21.107997 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-79af09fa-d891-4895-9f8e-5b5ce6aa360b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097" status: 200 len: 1508 microversion: 2.1 time: 0.165541 Jan 28 01:00:21.109070 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 533/1036] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:20 2022] GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:21.125113 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ac18cd6f-0258-4504-a614-ee4443111ea6 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1fd853c-3c8b-4666-b5e4-d6c35d1733cb"}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:21.126464 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ac18cd6f-0258-4504-a614-ee4443111ea6 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: efac69d4-1999-4729-a1f5-2242cc25f097] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:21.133052 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ac18cd6f-0258-4504-a614-ee4443111ea6 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:21.133510 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ac18cd6f-0258-4504-a614-ee4443111ea6 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:21.134316 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ac18cd6f-0258-4504-a614-ee4443111ea6 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:21.134834 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ac18cd6f-0258-4504-a614-ee4443111ea6 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:21.220728 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-ac18cd6f-0258-4504-a614-ee4443111ea6 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] HTTP exception thrown: Invalid volume: volume b1fd853c-3c8b-4666-b5e4-d6c35d1733cb is already attached to instances: e1a65c64-c2b0-41aa-94f9-733eb4541ba3 Jan 28 01:00:21.221334 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ac18cd6f-0258-4504-a614-ee4443111ea6 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Returning 400 to user: Invalid volume: volume b1fd853c-3c8b-4666-b5e4-d6c35d1733cb is already attached to instances: e1a65c64-c2b0-41aa-94f9-733eb4541ba3 {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:00:21.222168 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ac18cd6f-0258-4504-a614-ee4443111ea6 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "POST /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101321 Jan 28 01:00:21.222731 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 504/1037] 10.222.0.25 () {60 vars in 1322 bytes} [Fri Jan 28 01:00:21 2022] POST /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:00:21.255553 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-27599529-de40-4de6-91b7-9bfc11763168 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:21.256306 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-27599529-de40-4de6-91b7-9bfc11763168 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:21.262806 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-27599529-de40-4de6-91b7-9bfc11763168 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:21.263289 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-27599529-de40-4de6-91b7-9bfc11763168 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:21.264166 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-27599529-de40-4de6-91b7-9bfc11763168 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:21.264877 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-27599529-de40-4de6-91b7-9bfc11763168 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:21.317863 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f10eef0a-3a3a-4ce0-b2fe-07fad32bd16a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:21.317863 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f10eef0a-3a3a-4ce0-b2fe-07fad32bd16a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:21.333115 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f10eef0a-3a3a-4ce0-b2fe-07fad32bd16a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:21.333860 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f10eef0a-3a3a-4ce0-b2fe-07fad32bd16a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:21.336672 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f10eef0a-3a3a-4ce0-b2fe-07fad32bd16a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:21.338276 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f10eef0a-3a3a-4ce0-b2fe-07fad32bd16a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:21.453606 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.objects.instance [None req-f10eef0a-3a3a-4ce0-b2fe-07fad32bd16a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lazy-loading 'services' on Instance uuid e1a65c64-c2b0-41aa-94f9-733eb4541ba3 {{(pid=127863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:00:21.463070 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-27599529-de40-4de6-91b7-9bfc11763168 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:21.472680 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-27599529-de40-4de6-91b7-9bfc11763168 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1266 microversion: 2.1 time: 0.221316 Jan 28 01:00:21.473621 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 534/1038] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:21 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:21.552616 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f10eef0a-3a3a-4ce0-b2fe-07fad32bd16a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3/os-volume_attachments/b1fd853c-3c8b-4666-b5e4-d6c35d1733cb" status: 202 len: 0 microversion: 2.1 time: 0.264464 Jan 28 01:00:21.553773 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 505/1039] 10.222.0.25 () {58 vars in 1415 bytes} [Fri Jan 28 01:00:21 2022] DELETE /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3/os-volume_attachments/b1fd853c-3c8b-4666-b5e4-d6c35d1733cb => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:00:21.564243 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-976e7e1f-21d7-49aa-a3d8-ac48c7ae40de tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:21.565492 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-976e7e1f-21d7-49aa-a3d8-ac48c7ae40de tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:21.574712 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-976e7e1f-21d7-49aa-a3d8-ac48c7ae40de tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:21.575351 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-976e7e1f-21d7-49aa-a3d8-ac48c7ae40de tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:21.577783 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-976e7e1f-21d7-49aa-a3d8-ac48c7ae40de tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:21.578791 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-976e7e1f-21d7-49aa-a3d8-ac48c7ae40de tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:21.633585 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-976e7e1f-21d7-49aa-a3d8-ac48c7ae40de tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074069 Jan 28 01:00:21.634657 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 535/1040] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 01:00:21 2022] GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:00:22.501453 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-29562f49-c9c7-44a3-9132-63e9145b1d83 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:22.502511 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-29562f49-c9c7-44a3-9132-63e9145b1d83 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:22.509828 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-29562f49-c9c7-44a3-9132-63e9145b1d83 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:22.510644 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-29562f49-c9c7-44a3-9132-63e9145b1d83 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:22.511682 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-29562f49-c9c7-44a3-9132-63e9145b1d83 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:22.512345 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-29562f49-c9c7-44a3-9132-63e9145b1d83 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:22.647205 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f9538d95-05b7-4521-8ad7-61b31ffa4420 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:22.648674 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f9538d95-05b7-4521-8ad7-61b31ffa4420 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:22.665812 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f9538d95-05b7-4521-8ad7-61b31ffa4420 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:22.666265 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f9538d95-05b7-4521-8ad7-61b31ffa4420 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:22.667293 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f9538d95-05b7-4521-8ad7-61b31ffa4420 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:22.667736 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f9538d95-05b7-4521-8ad7-61b31ffa4420 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:22.708315 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f9538d95-05b7-4521-8ad7-61b31ffa4420 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065496 Jan 28 01:00:22.708812 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 536/1041] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 01:00:22 2022] GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 01:00:22.714725 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-29562f49-c9c7-44a3-9132-63e9145b1d83 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:22.723741 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-29562f49-c9c7-44a3-9132-63e9145b1d83 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1266 microversion: 2.1 time: 0.227818 Jan 28 01:00:22.724345 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 506/1042] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:22 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:22.879650 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-5624cef8-7b32-47e1-a5c5-f46537299bf8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1797088998", "imageRef": "7fe09c59-2ff9-4639-b39d-9a474e83ad91", "flavorRef": "452", "networks": [{"uuid": "24e25033-acbb-46d6-9923-f2b3f53599d8"}]}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:22.934574 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.network.neutron [None req-5624cef8-7b32-47e1-a5c5-f46537299bf8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] validate_networks() for [('24e25033-acbb-46d6-9923-f2b3f53599d8', None, None, None, None, None)] {{(pid=127862) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:00:23.094709 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:00:23.095008 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: Fri Jan 28 01:00:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Jan 28 01:00:23.321170 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-5624cef8-7b32-47e1-a5c5-f46537299bf8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Flavor limits 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:00:23.321604 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-5624cef8-7b32-47e1-a5c5-f46537299bf8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Image limits 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:00:23.322120 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-5624cef8-7b32-47e1-a5c5-f46537299bf8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Flavor pref 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:00:23.322531 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-5624cef8-7b32-47e1-a5c5-f46537299bf8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Image pref 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:00:23.322952 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-5624cef8-7b32-47e1-a5c5-f46537299bf8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:00:23.334220 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5624cef8-7b32-47e1-a5c5-f46537299bf8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:23.334680 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5624cef8-7b32-47e1-a5c5-f46537299bf8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:23.335544 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5624cef8-7b32-47e1-a5c5-f46537299bf8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:23.335993 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5624cef8-7b32-47e1-a5c5-f46537299bf8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:23.354022 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-5624cef8-7b32-47e1-a5c5-f46537299bf8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Getting quotas for project 8ac4f28c68b8487191e2129b9764168c. Resources: {'instances', 'cores', 'ram'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:00:23.359201 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-5624cef8-7b32-47e1-a5c5-f46537299bf8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Getting quotas for user 1e102510ea4043db92408769929a2884 and project 8ac4f28c68b8487191e2129b9764168c. Resources: {'instances', 'cores', 'ram'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:00:23.370130 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-5624cef8-7b32-47e1-a5c5-f46537299bf8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Going to run 1 instances... {{(pid=127862) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:00:23.372534 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-5624cef8-7b32-47e1-a5c5-f46537299bf8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fe09c59-2ff9-4639-b39d-9a474e83ad91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:00:23.436197 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-5624cef8-7b32-47e1-a5c5-f46537299bf8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560460 Jan 28 01:00:23.437309 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 537/1043] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 01:00:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:00:23.453665 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e6a864e9-da89-47f8-872c-ec23a677a815 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:23.454715 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e6a864e9-da89-47f8-872c-ec23a677a815 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:23.521833 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e6a864e9-da89-47f8-872c-ec23a677a815 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:23.530105 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e6a864e9-da89-47f8-872c-ec23a677a815 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1218 microversion: 2.1 time: 0.083425 Jan 28 01:00:23.531085 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 507/1044] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:23 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:23.742846 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f69f3c72-1515-496c-82ae-49339d6d647e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:23.743537 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f69f3c72-1515-496c-82ae-49339d6d647e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:23.749959 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f69f3c72-1515-496c-82ae-49339d6d647e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:23.750451 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f69f3c72-1515-496c-82ae-49339d6d647e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:23.751406 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f69f3c72-1515-496c-82ae-49339d6d647e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:23.751744 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f69f3c72-1515-496c-82ae-49339d6d647e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:23.903651 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f69f3c72-1515-496c-82ae-49339d6d647e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:23.911739 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f69f3c72-1515-496c-82ae-49339d6d647e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1266 microversion: 2.1 time: 0.173755 Jan 28 01:00:23.912351 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 538/1045] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:23 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:24.548387 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c9175d41-0022-49dc-92f1-7dbc904e3a40 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:24.549036 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c9175d41-0022-49dc-92f1-7dbc904e3a40 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:24.558305 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c9175d41-0022-49dc-92f1-7dbc904e3a40 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:24.558756 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c9175d41-0022-49dc-92f1-7dbc904e3a40 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:24.559598 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c9175d41-0022-49dc-92f1-7dbc904e3a40 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:24.560054 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c9175d41-0022-49dc-92f1-7dbc904e3a40 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:24.622894 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-c9175d41-0022-49dc-92f1-7dbc904e3a40 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:24.631291 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c9175d41-0022-49dc-92f1-7dbc904e3a40 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1222 microversion: 2.1 time: 0.087587 Jan 28 01:00:24.631882 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 508/1046] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:24 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:24.931631 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ed5e226c-646f-44c2-8f21-02eb33c212f7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:24.932211 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ed5e226c-646f-44c2-8f21-02eb33c212f7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:24.940125 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ed5e226c-646f-44c2-8f21-02eb33c212f7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:24.940602 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ed5e226c-646f-44c2-8f21-02eb33c212f7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:24.941429 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ed5e226c-646f-44c2-8f21-02eb33c212f7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:24.941883 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ed5e226c-646f-44c2-8f21-02eb33c212f7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:25.094630 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ed5e226c-646f-44c2-8f21-02eb33c212f7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:25.103431 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ed5e226c-646f-44c2-8f21-02eb33c212f7 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1266 microversion: 2.1 time: 0.175872 Jan 28 01:00:25.104023 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 539/1047] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:24 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:25.648848 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f7ad71d8-eb77-46d7-a35b-3ca4ad5ec700 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:25.649480 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f7ad71d8-eb77-46d7-a35b-3ca4ad5ec700 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:25.656899 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f7ad71d8-eb77-46d7-a35b-3ca4ad5ec700 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:25.657353 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f7ad71d8-eb77-46d7-a35b-3ca4ad5ec700 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:25.658181 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f7ad71d8-eb77-46d7-a35b-3ca4ad5ec700 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:25.658623 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f7ad71d8-eb77-46d7-a35b-3ca4ad5ec700 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:25.722967 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f7ad71d8-eb77-46d7-a35b-3ca4ad5ec700 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:25.730343 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f7ad71d8-eb77-46d7-a35b-3ca4ad5ec700 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1222 microversion: 2.1 time: 0.085836 Jan 28 01:00:25.730912 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 509/1048] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:25 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:26.121182 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-8ba2fd3b-0806-41e9-bb26-025c0bdf977a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:26.122014 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-8ba2fd3b-0806-41e9-bb26-025c0bdf977a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:26.128968 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8ba2fd3b-0806-41e9-bb26-025c0bdf977a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:26.129429 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8ba2fd3b-0806-41e9-bb26-025c0bdf977a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:26.130244 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8ba2fd3b-0806-41e9-bb26-025c0bdf977a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:26.130676 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8ba2fd3b-0806-41e9-bb26-025c0bdf977a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:26.267498 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-8ba2fd3b-0806-41e9-bb26-025c0bdf977a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:26.275414 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-8ba2fd3b-0806-41e9-bb26-025c0bdf977a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1266 microversion: 2.1 time: 0.158058 Jan 28 01:00:26.276014 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 540/1049] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:26 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:26.749385 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-db6e4811-1108-4367-8b2f-698113b18f7c tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:26.750356 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-db6e4811-1108-4367-8b2f-698113b18f7c tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:26.757024 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-db6e4811-1108-4367-8b2f-698113b18f7c tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:26.757478 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-db6e4811-1108-4367-8b2f-698113b18f7c tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:26.758291 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-db6e4811-1108-4367-8b2f-698113b18f7c tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:26.758739 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-db6e4811-1108-4367-8b2f-698113b18f7c tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:26.847336 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-db6e4811-1108-4367-8b2f-698113b18f7c tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:26.856277 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-db6e4811-1108-4367-8b2f-698113b18f7c tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1276 microversion: 2.1 time: 0.111330 Jan 28 01:00:26.865971 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 510/1050] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:26 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1276 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:27.293464 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-63c14af3-d404-415f-a197-b38a19b51c2a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:27.294073 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-63c14af3-d404-415f-a197-b38a19b51c2a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:27.301594 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-63c14af3-d404-415f-a197-b38a19b51c2a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:27.302307 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-63c14af3-d404-415f-a197-b38a19b51c2a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:27.303110 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-63c14af3-d404-415f-a197-b38a19b51c2a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:27.303585 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-63c14af3-d404-415f-a197-b38a19b51c2a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:27.471988 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-63c14af3-d404-415f-a197-b38a19b51c2a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:27.480179 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-63c14af3-d404-415f-a197-b38a19b51c2a tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1266 microversion: 2.1 time: 0.190106 Jan 28 01:00:27.490991 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 541/1051] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:27 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:27.875745 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-30169a3a-f2b3-4816-a729-87f6f9460af1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:27.876626 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-30169a3a-f2b3-4816-a729-87f6f9460af1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:27.883432 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-30169a3a-f2b3-4816-a729-87f6f9460af1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:27.883891 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-30169a3a-f2b3-4816-a729-87f6f9460af1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:27.884701 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-30169a3a-f2b3-4816-a729-87f6f9460af1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:27.885138 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-30169a3a-f2b3-4816-a729-87f6f9460af1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:28.057840 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-30169a3a-f2b3-4816-a729-87f6f9460af1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:28.068921 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-30169a3a-f2b3-4816-a729-87f6f9460af1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1318 microversion: 2.1 time: 0.198563 Jan 28 01:00:28.069389 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-8165a6c0-fc38-4989-bb3a-e56dd9eb26f0 req-7e5a0f28-6d7c-487d-af31-751aea437677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "846938ed-7651-44a3-8db6-ae8b9a80ca1a", "tag": "fbcec141-aef9-4841-b5c0-4a95c625680b"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:28.070923 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 511/1052] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:27 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:28.071125 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:00:28.071125 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 01:00:28.079739 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-8165a6c0-fc38-4989-bb3a-e56dd9eb26f0 req-7e5a0f28-6d7c-487d-af31-751aea437677 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:28.080274 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-8165a6c0-fc38-4989-bb3a-e56dd9eb26f0 req-7e5a0f28-6d7c-487d-af31-751aea437677 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:28.094580 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-8165a6c0-fc38-4989-bb3a-e56dd9eb26f0 req-7e5a0f28-6d7c-487d-af31-751aea437677 service nova] Creating event network-changed:fbcec141-aef9-4841-b5c0-4a95c625680b for instance 846938ed-7651-44a3-8db6-ae8b9a80ca1a on hv-cinder-80952 Jan 28 01:00:28.100242 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-8165a6c0-fc38-4989-bb3a-e56dd9eb26f0 req-7e5a0f28-6d7c-487d-af31-751aea437677 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034737 Jan 28 01:00:28.100890 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 542/1053] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:00:28.501621 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5799194c-3a8b-45d0-be99-fa26575f6f63 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:28.502403 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5799194c-3a8b-45d0-be99-fa26575f6f63 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:28.510781 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5799194c-3a8b-45d0-be99-fa26575f6f63 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:28.511432 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5799194c-3a8b-45d0-be99-fa26575f6f63 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:28.512515 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5799194c-3a8b-45d0-be99-fa26575f6f63 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:28.513165 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5799194c-3a8b-45d0-be99-fa26575f6f63 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:28.724642 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-5799194c-3a8b-45d0-be99-fa26575f6f63 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:28.735382 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5799194c-3a8b-45d0-be99-fa26575f6f63 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1266 microversion: 2.1 time: 0.239740 Jan 28 01:00:28.735995 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 512/1054] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:28 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:29.098307 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-25dc7a67-aeeb-4689-9fb4-aef854850957 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:29.099741 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-25dc7a67-aeeb-4689-9fb4-aef854850957 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:29.111516 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-25dc7a67-aeeb-4689-9fb4-aef854850957 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:29.112585 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-25dc7a67-aeeb-4689-9fb4-aef854850957 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:29.114086 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-25dc7a67-aeeb-4689-9fb4-aef854850957 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:29.114952 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-25dc7a67-aeeb-4689-9fb4-aef854850957 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:29.282472 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-25dc7a67-aeeb-4689-9fb4-aef854850957 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:29.291517 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-25dc7a67-aeeb-4689-9fb4-aef854850957 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1318 microversion: 2.1 time: 0.203754 Jan 28 01:00:29.292125 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 543/1055] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:29 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:29.754305 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-0d7a80ec-a1f3-4e3b-896e-1aff6b62556d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:29.755224 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-0d7a80ec-a1f3-4e3b-896e-1aff6b62556d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:29.765602 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0d7a80ec-a1f3-4e3b-896e-1aff6b62556d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:29.766645 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0d7a80ec-a1f3-4e3b-896e-1aff6b62556d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:29.768122 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0d7a80ec-a1f3-4e3b-896e-1aff6b62556d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:29.768928 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-0d7a80ec-a1f3-4e3b-896e-1aff6b62556d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:29.988783 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-0d7a80ec-a1f3-4e3b-896e-1aff6b62556d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:30.003473 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-0d7a80ec-a1f3-4e3b-896e-1aff6b62556d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1266 microversion: 2.1 time: 0.253475 Jan 28 01:00:30.004937 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 513/1056] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:29 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:30.312215 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-8bff9568-cb72-47aa-9478-46e16a0bc898 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:30.312931 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-8bff9568-cb72-47aa-9478-46e16a0bc898 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:30.323231 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8bff9568-cb72-47aa-9478-46e16a0bc898 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:30.323847 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8bff9568-cb72-47aa-9478-46e16a0bc898 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:30.325102 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8bff9568-cb72-47aa-9478-46e16a0bc898 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:30.325697 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8bff9568-cb72-47aa-9478-46e16a0bc898 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:30.555689 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-8bff9568-cb72-47aa-9478-46e16a0bc898 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:30.568035 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-8bff9568-cb72-47aa-9478-46e16a0bc898 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1318 microversion: 2.1 time: 0.260337 Jan 28 01:00:30.569411 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 544/1057] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:30 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:30.790765 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-7cb6efad-ce3a-4a64-9187-a3306572629c req-a6b5e24c-3223-4499-82f2-50ab8352f154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c98be1-6473-4b8f-9c94-12eef8495893", "name": "network-vif-plugged", "status": "completed", "tag": "fa936154-1bb4-41ee-b929-553ae9ae8f60"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:30.793625 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:00:30.793625 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 01:00:30.806489 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-7cb6efad-ce3a-4a64-9187-a3306572629c req-a6b5e24c-3223-4499-82f2-50ab8352f154 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:30.807444 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-7cb6efad-ce3a-4a64-9187-a3306572629c req-a6b5e24c-3223-4499-82f2-50ab8352f154 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:30.828902 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-7cb6efad-ce3a-4a64-9187-a3306572629c req-a6b5e24c-3223-4499-82f2-50ab8352f154 service nova] Creating event network-vif-plugged:fa936154-1bb4-41ee-b929-553ae9ae8f60 for instance 92c98be1-6473-4b8f-9c94-12eef8495893 on hv-cinder-80952 Jan 28 01:00:30.837705 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-7cb6efad-ce3a-4a64-9187-a3306572629c req-a6b5e24c-3223-4499-82f2-50ab8352f154 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052735 Jan 28 01:00:30.839161 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 514/1058] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:00:31.023297 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-957f3093-4447-4441-901d-b2cc7f9fb19d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:31.024273 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-957f3093-4447-4441-901d-b2cc7f9fb19d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:31.034588 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-957f3093-4447-4441-901d-b2cc7f9fb19d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:31.035329 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-957f3093-4447-4441-901d-b2cc7f9fb19d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:31.036954 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-957f3093-4447-4441-901d-b2cc7f9fb19d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:31.037811 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-957f3093-4447-4441-901d-b2cc7f9fb19d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:31.248327 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-957f3093-4447-4441-901d-b2cc7f9fb19d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:31.258341 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-957f3093-4447-4441-901d-b2cc7f9fb19d tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1266 microversion: 2.1 time: 0.239644 Jan 28 01:00:31.259461 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 545/1059] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:31 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:31.594839 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-44031388-228a-43d1-b808-9f16d33b04c5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:31.595770 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-44031388-228a-43d1-b808-9f16d33b04c5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:31.603045 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-44031388-228a-43d1-b808-9f16d33b04c5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:31.603749 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-44031388-228a-43d1-b808-9f16d33b04c5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:31.604734 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-44031388-228a-43d1-b808-9f16d33b04c5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:31.605305 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-44031388-228a-43d1-b808-9f16d33b04c5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:31.775906 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-44031388-228a-43d1-b808-9f16d33b04c5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:31.787719 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-44031388-228a-43d1-b808-9f16d33b04c5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1318 microversion: 2.1 time: 0.198233 Jan 28 01:00:31.788385 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 515/1060] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:31 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:32.278562 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-89fe1bb4-e642-418e-89be-2b79be7413d4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:32.279436 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-89fe1bb4-e642-418e-89be-2b79be7413d4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:32.287887 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-89fe1bb4-e642-418e-89be-2b79be7413d4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:32.288404 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-89fe1bb4-e642-418e-89be-2b79be7413d4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:32.289442 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-89fe1bb4-e642-418e-89be-2b79be7413d4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:32.290039 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-89fe1bb4-e642-418e-89be-2b79be7413d4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:32.492637 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-89fe1bb4-e642-418e-89be-2b79be7413d4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:32.502517 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-89fe1bb4-e642-418e-89be-2b79be7413d4 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1266 microversion: 2.1 time: 0.228179 Jan 28 01:00:32.503783 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 546/1061] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:32 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:32.810761 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-946e0a94-dd04-4dc9-8417-cb5dc62b68b3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:32.813354 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-946e0a94-dd04-4dc9-8417-cb5dc62b68b3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:32.828122 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-946e0a94-dd04-4dc9-8417-cb5dc62b68b3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:32.828905 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-946e0a94-dd04-4dc9-8417-cb5dc62b68b3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:32.830413 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-946e0a94-dd04-4dc9-8417-cb5dc62b68b3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:32.831491 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-946e0a94-dd04-4dc9-8417-cb5dc62b68b3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:33.038868 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-946e0a94-dd04-4dc9-8417-cb5dc62b68b3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:33.049073 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-946e0a94-dd04-4dc9-8417-cb5dc62b68b3 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1318 microversion: 2.1 time: 0.246361 Jan 28 01:00:33.049673 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 516/1062] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:32 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:33.526706 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-88cfbeee-c32e-4530-80c8-18c9ef8aa956 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:33.527911 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-88cfbeee-c32e-4530-80c8-18c9ef8aa956 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:33.540827 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-88cfbeee-c32e-4530-80c8-18c9ef8aa956 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:33.541676 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-88cfbeee-c32e-4530-80c8-18c9ef8aa956 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:33.543182 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-88cfbeee-c32e-4530-80c8-18c9ef8aa956 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:33.544026 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-88cfbeee-c32e-4530-80c8-18c9ef8aa956 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:33.693568 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-88cfbeee-c32e-4530-80c8-18c9ef8aa956 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:33.702791 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-88cfbeee-c32e-4530-80c8-18c9ef8aa956 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1454 microversion: 2.1 time: 0.183424 Jan 28 01:00:33.703601 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 547/1063] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:33 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1454 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:33.720185 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-79fb23c8-fa26-492c-a491-6b8ebf6acaf2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:33.720894 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-79fb23c8-fa26-492c-a491-6b8ebf6acaf2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:33.727068 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-79fb23c8-fa26-492c-a491-6b8ebf6acaf2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:33.727565 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-79fb23c8-fa26-492c-a491-6b8ebf6acaf2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:33.728365 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-79fb23c8-fa26-492c-a491-6b8ebf6acaf2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:33.728809 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-79fb23c8-fa26-492c-a491-6b8ebf6acaf2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:33.899603 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-79fb23c8-fa26-492c-a491-6b8ebf6acaf2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:33.912390 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-79fb23c8-fa26-492c-a491-6b8ebf6acaf2 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1454 microversion: 2.1 time: 0.197050 Jan 28 01:00:33.913049 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 517/1064] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:33 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1454 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:34.072646 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-fb733974-73c2-46e6-8cfd-ab94c3a93fa0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:34.073471 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-fb733974-73c2-46e6-8cfd-ab94c3a93fa0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:34.081494 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fb733974-73c2-46e6-8cfd-ab94c3a93fa0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:34.082092 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fb733974-73c2-46e6-8cfd-ab94c3a93fa0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:34.083106 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fb733974-73c2-46e6-8cfd-ab94c3a93fa0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:34.083723 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-fb733974-73c2-46e6-8cfd-ab94c3a93fa0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:34.322525 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-fb733974-73c2-46e6-8cfd-ab94c3a93fa0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:34.331134 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-fb733974-73c2-46e6-8cfd-ab94c3a93fa0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1318 microversion: 2.1 time: 0.266530 Jan 28 01:00:34.331772 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 548/1065] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:34 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:35.360382 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-24967845-5168-410e-83da-648e0a28fb31 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:35.361526 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-24967845-5168-410e-83da-648e0a28fb31 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:35.371322 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-24967845-5168-410e-83da-648e0a28fb31 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:35.371903 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-24967845-5168-410e-83da-648e0a28fb31 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:35.372882 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-24967845-5168-410e-83da-648e0a28fb31 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:35.373448 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-24967845-5168-410e-83da-648e0a28fb31 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:35.528156 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-24967845-5168-410e-83da-648e0a28fb31 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:35.541493 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-24967845-5168-410e-83da-648e0a28fb31 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1318 microversion: 2.1 time: 0.188266 Jan 28 01:00:35.542479 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 518/1066] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:35 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:00:36.512223 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-f6b38618-b857-4db0-a692-899e8d5f51ce req-a2afc03d-0609-4c00-8e9e-918197f88f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c98be1-6473-4b8f-9c94-12eef8495893", "tag": "fa936154-1bb4-41ee-b929-553ae9ae8f60"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:36.515799 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:00:36.515799 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 01:00:36.525194 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-f6b38618-b857-4db0-a692-899e8d5f51ce req-a2afc03d-0609-4c00-8e9e-918197f88f36 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:36.525733 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-f6b38618-b857-4db0-a692-899e8d5f51ce req-a2afc03d-0609-4c00-8e9e-918197f88f36 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:36.540151 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-f6b38618-b857-4db0-a692-899e8d5f51ce req-a2afc03d-0609-4c00-8e9e-918197f88f36 service nova] Creating event network-changed:fa936154-1bb4-41ee-b929-553ae9ae8f60 for instance 92c98be1-6473-4b8f-9c94-12eef8495893 on hv-cinder-80952 Jan 28 01:00:36.546400 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-f6b38618-b857-4db0-a692-899e8d5f51ce req-a2afc03d-0609-4c00-8e9e-918197f88f36 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039290 Jan 28 01:00:36.547100 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 549/1067] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:00:36.568408 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5da6869a-aecf-4c96-801b-e19a5e5f7e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:36.569037 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5da6869a-aecf-4c96-801b-e19a5e5f7e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:36.577582 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5da6869a-aecf-4c96-801b-e19a5e5f7e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:36.578201 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5da6869a-aecf-4c96-801b-e19a5e5f7e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:36.579631 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5da6869a-aecf-4c96-801b-e19a5e5f7e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:36.580425 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5da6869a-aecf-4c96-801b-e19a5e5f7e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:36.757731 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-5da6869a-aecf-4c96-801b-e19a5e5f7e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:36.767307 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5da6869a-aecf-4c96-801b-e19a5e5f7e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1318 microversion: 2.1 time: 0.203283 Jan 28 01:00:36.767917 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 519/1068] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:36 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:37.792456 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-5b8cbda1-15e7-455d-b406-49e0f274a77b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:37.793790 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-5b8cbda1-15e7-455d-b406-49e0f274a77b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:37.804854 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5b8cbda1-15e7-455d-b406-49e0f274a77b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:37.805524 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5b8cbda1-15e7-455d-b406-49e0f274a77b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:37.806706 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5b8cbda1-15e7-455d-b406-49e0f274a77b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:37.807404 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5b8cbda1-15e7-455d-b406-49e0f274a77b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:37.990519 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-5b8cbda1-15e7-455d-b406-49e0f274a77b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:38.002337 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-5b8cbda1-15e7-455d-b406-49e0f274a77b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1318 microversion: 2.1 time: 0.217248 Jan 28 01:00:38.003156 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 550/1069] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:37 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:38.750465 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-9600dcd1-7d82-4166-9565-84e0a8772455 req-705d2fa8-3c5d-4aaf-8e81-62fa3a69af4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846938ed-7651-44a3-8db6-ae8b9a80ca1a", "name": "network-vif-plugged", "status": "completed", "tag": "fbcec141-aef9-4841-b5c0-4a95c625680b"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:38.752547 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:00:38.752547 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 01:00:38.762752 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-9600dcd1-7d82-4166-9565-84e0a8772455 req-705d2fa8-3c5d-4aaf-8e81-62fa3a69af4e service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:38.764473 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-9600dcd1-7d82-4166-9565-84e0a8772455 req-705d2fa8-3c5d-4aaf-8e81-62fa3a69af4e service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:38.781961 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-9600dcd1-7d82-4166-9565-84e0a8772455 req-705d2fa8-3c5d-4aaf-8e81-62fa3a69af4e service nova] Creating event network-vif-plugged:fbcec141-aef9-4841-b5c0-4a95c625680b for instance 846938ed-7651-44a3-8db6-ae8b9a80ca1a on hv-cinder-80952 Jan 28 01:00:38.788196 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-9600dcd1-7d82-4166-9565-84e0a8772455 req-705d2fa8-3c5d-4aaf-8e81-62fa3a69af4e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044023 Jan 28 01:00:38.789043 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 520/1070] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:00:39.023756 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4484924b-ee9a-41aa-8ae2-de27979ce972 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:39.024764 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4484924b-ee9a-41aa-8ae2-de27979ce972 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:39.031794 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4484924b-ee9a-41aa-8ae2-de27979ce972 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:39.032259 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4484924b-ee9a-41aa-8ae2-de27979ce972 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:39.033072 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4484924b-ee9a-41aa-8ae2-de27979ce972 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:39.033523 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4484924b-ee9a-41aa-8ae2-de27979ce972 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:39.202802 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4484924b-ee9a-41aa-8ae2-de27979ce972 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:39.210828 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4484924b-ee9a-41aa-8ae2-de27979ce972 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1318 microversion: 2.1 time: 0.191191 Jan 28 01:00:39.211538 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 551/1071] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:39 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:40.229946 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1e32fa7f-860c-47d6-b4ad-4a84b87c5008 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:40.230748 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-1e32fa7f-860c-47d6-b4ad-4a84b87c5008 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:40.238879 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1e32fa7f-860c-47d6-b4ad-4a84b87c5008 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:40.239376 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1e32fa7f-860c-47d6-b4ad-4a84b87c5008 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:40.240212 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1e32fa7f-860c-47d6-b4ad-4a84b87c5008 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:40.240662 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1e32fa7f-860c-47d6-b4ad-4a84b87c5008 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:40.411035 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-1e32fa7f-860c-47d6-b4ad-4a84b87c5008 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:40.419590 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1e32fa7f-860c-47d6-b4ad-4a84b87c5008 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1318 microversion: 2.1 time: 0.194257 Jan 28 01:00:40.420892 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 521/1072] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:40 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:41.438717 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-8e1d8ea5-b071-4174-8aca-0846fe099220 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:41.439527 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-8e1d8ea5-b071-4174-8aca-0846fe099220 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:41.446755 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8e1d8ea5-b071-4174-8aca-0846fe099220 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:41.447360 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8e1d8ea5-b071-4174-8aca-0846fe099220 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:41.448262 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8e1d8ea5-b071-4174-8aca-0846fe099220 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:41.448751 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8e1d8ea5-b071-4174-8aca-0846fe099220 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:41.624936 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-8e1d8ea5-b071-4174-8aca-0846fe099220 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:41.633564 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-8e1d8ea5-b071-4174-8aca-0846fe099220 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1318 microversion: 2.1 time: 0.199366 Jan 28 01:00:41.634261 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 552/1073] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:41 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:42.655122 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-57acf46e-267c-4054-bed1-141aef7f7df4 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:42.656714 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-57acf46e-267c-4054-bed1-141aef7f7df4 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:42.665267 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-57acf46e-267c-4054-bed1-141aef7f7df4 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:42.666054 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-57acf46e-267c-4054-bed1-141aef7f7df4 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:42.666786 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-57acf46e-267c-4054-bed1-141aef7f7df4 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:42.667933 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-57acf46e-267c-4054-bed1-141aef7f7df4 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:42.944649 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-57acf46e-267c-4054-bed1-141aef7f7df4 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:42.955237 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-57acf46e-267c-4054-bed1-141aef7f7df4 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1318 microversion: 2.1 time: 0.303821 Jan 28 01:00:42.958287 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 522/1074] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:42 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:43.976507 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3d155ddb-7ba7-489e-a618-239f06764cbe tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:43.977067 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3d155ddb-7ba7-489e-a618-239f06764cbe tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:43.983906 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3d155ddb-7ba7-489e-a618-239f06764cbe tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:43.984409 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3d155ddb-7ba7-489e-a618-239f06764cbe tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:43.985662 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3d155ddb-7ba7-489e-a618-239f06764cbe tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:43.986179 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3d155ddb-7ba7-489e-a618-239f06764cbe tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:44.176504 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3d155ddb-7ba7-489e-a618-239f06764cbe tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:44.190418 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3d155ddb-7ba7-489e-a618-239f06764cbe tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1318 microversion: 2.1 time: 0.217629 Jan 28 01:00:44.191323 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 553/1075] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:43 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:45.213865 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a7734604-f55d-4665-99d5-54e6a821811a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:45.214700 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a7734604-f55d-4665-99d5-54e6a821811a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:45.224177 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a7734604-f55d-4665-99d5-54e6a821811a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:45.224818 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a7734604-f55d-4665-99d5-54e6a821811a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:45.225935 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a7734604-f55d-4665-99d5-54e6a821811a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:45.226544 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a7734604-f55d-4665-99d5-54e6a821811a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:45.411464 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a7734604-f55d-4665-99d5-54e6a821811a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:45.421390 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a7734604-f55d-4665-99d5-54e6a821811a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1318 microversion: 2.1 time: 0.212675 Jan 28 01:00:45.422185 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 523/1076] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:45 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:46.445920 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3ad77c37-5ef4-46fe-bd48-d8841bfaabbc tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:46.446679 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3ad77c37-5ef4-46fe-bd48-d8841bfaabbc tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:46.455663 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3ad77c37-5ef4-46fe-bd48-d8841bfaabbc tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:46.456264 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3ad77c37-5ef4-46fe-bd48-d8841bfaabbc tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:46.457359 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3ad77c37-5ef4-46fe-bd48-d8841bfaabbc tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:46.458008 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3ad77c37-5ef4-46fe-bd48-d8841bfaabbc tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:46.646237 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-3ad77c37-5ef4-46fe-bd48-d8841bfaabbc tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:46.656661 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3ad77c37-5ef4-46fe-bd48-d8841bfaabbc tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1318 microversion: 2.1 time: 0.217124 Jan 28 01:00:46.659349 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 554/1077] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:46 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:47.679016 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-54486304-932e-4e2b-9fd9-e501d9f12cec tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:00:47.679981 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-54486304-932e-4e2b-9fd9-e501d9f12cec tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:47.688639 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-54486304-932e-4e2b-9fd9-e501d9f12cec tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:47.689131 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-54486304-932e-4e2b-9fd9-e501d9f12cec tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:47.690178 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-54486304-932e-4e2b-9fd9-e501d9f12cec tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:47.690690 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-54486304-932e-4e2b-9fd9-e501d9f12cec tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:47.890623 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-54486304-932e-4e2b-9fd9-e501d9f12cec tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:00:47.901273 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-54486304-932e-4e2b-9fd9-e501d9f12cec tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1507 microversion: 2.1 time: 0.226554 Jan 28 01:00:47.901904 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 524/1078] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:00:47 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1507 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:00:49.304927 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-e9e42931-2764-4d32-b41c-20032e8fec7b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc35907a-72f1-47c1-a47a-b310eb7b4de4"}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:00:49.306022 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-e9e42931-2764-4d32-b41c-20032e8fec7b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:00:49.312753 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e9e42931-2764-4d32-b41c-20032e8fec7b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:49.313308 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e9e42931-2764-4d32-b41c-20032e8fec7b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:49.314124 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e9e42931-2764-4d32-b41c-20032e8fec7b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:00:49.314568 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-e9e42931-2764-4d32-b41c-20032e8fec7b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:00:49.640608 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-e9e42931-2764-4d32-b41c-20032e8fec7b tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "POST /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339645 Jan 28 01:00:49.641373 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 555/1079] 10.222.0.25 () {60 vars in 1322 bytes} [Fri Jan 28 01:00:49 2022] POST /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:00.361423 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5835fd57-38e4-49fb-842c-7ed3f8d2196c tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc35907a-72f1-47c1-a47a-b310eb7b4de4"}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:00.363512 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5835fd57-38e4-49fb-842c-7ed3f8d2196c tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:00.372482 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5835fd57-38e4-49fb-842c-7ed3f8d2196c tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:00.373057 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5835fd57-38e4-49fb-842c-7ed3f8d2196c tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:00.374637 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5835fd57-38e4-49fb-842c-7ed3f8d2196c tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:00.375130 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5835fd57-38e4-49fb-842c-7ed3f8d2196c tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:00.454907 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-5835fd57-38e4-49fb-842c-7ed3f8d2196c tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] HTTP exception thrown: Invalid volume: volume dc35907a-72f1-47c1-a47a-b310eb7b4de4 is already attached to instances: 846938ed-7651-44a3-8db6-ae8b9a80ca1a Jan 28 01:01:00.455551 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5835fd57-38e4-49fb-842c-7ed3f8d2196c tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Returning 400 to user: Invalid volume: volume dc35907a-72f1-47c1-a47a-b310eb7b4de4 is already attached to instances: 846938ed-7651-44a3-8db6-ae8b9a80ca1a {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:01:00.456439 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5835fd57-38e4-49fb-842c-7ed3f8d2196c tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "POST /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103329 Jan 28 01:01:00.456953 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 525/1080] 10.222.0.25 () {60 vars in 1322 bytes} [Fri Jan 28 01:01:00 2022] POST /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:01:00.518695 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-75d277fb-a393-42ae-88d2-a5d40bfd6c70 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:00.519317 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-75d277fb-a393-42ae-88d2-a5d40bfd6c70 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:00.525871 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-75d277fb-a393-42ae-88d2-a5d40bfd6c70 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:00.526324 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-75d277fb-a393-42ae-88d2-a5d40bfd6c70 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:00.527121 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-75d277fb-a393-42ae-88d2-a5d40bfd6c70 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:00.527595 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-75d277fb-a393-42ae-88d2-a5d40bfd6c70 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:00.607232 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.objects.instance [None req-75d277fb-a393-42ae-88d2-a5d40bfd6c70 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lazy-loading 'services' on Instance uuid 846938ed-7651-44a3-8db6-ae8b9a80ca1a {{(pid=127862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:01:00.690402 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-75d277fb-a393-42ae-88d2-a5d40bfd6c70 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "DELETE /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a/os-volume_attachments/dc35907a-72f1-47c1-a47a-b310eb7b4de4" status: 202 len: 0 microversion: 2.1 time: 0.176825 Jan 28 01:01:00.691116 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 556/1081] 10.222.0.25 () {58 vars in 1415 bytes} [Fri Jan 28 01:01:00 2022] DELETE /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a/os-volume_attachments/dc35907a-72f1-47c1-a47a-b310eb7b4de4 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:01:00.700226 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2cb6eb63-c80d-4687-8fa8-a72968048a53 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:00.701551 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2cb6eb63-c80d-4687-8fa8-a72968048a53 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:00.709367 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2cb6eb63-c80d-4687-8fa8-a72968048a53 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:00.709716 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2cb6eb63-c80d-4687-8fa8-a72968048a53 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:00.710552 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2cb6eb63-c80d-4687-8fa8-a72968048a53 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:00.711013 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2cb6eb63-c80d-4687-8fa8-a72968048a53 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:00.755256 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2cb6eb63-c80d-4687-8fa8-a72968048a53 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059385 Jan 28 01:01:00.755896 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 526/1082] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 01:01:00 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:01.773495 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f3d41d5e-d69a-4965-83ae-3922ff9193f5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:01.774471 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f3d41d5e-d69a-4965-83ae-3922ff9193f5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:01.784217 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f3d41d5e-d69a-4965-83ae-3922ff9193f5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:01.785080 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f3d41d5e-d69a-4965-83ae-3922ff9193f5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:01.786598 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f3d41d5e-d69a-4965-83ae-3922ff9193f5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:01.787457 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f3d41d5e-d69a-4965-83ae-3922ff9193f5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:01.821957 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f3d41d5e-d69a-4965-83ae-3922ff9193f5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053197 Jan 28 01:01:01.822527 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 557/1083] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 01:01:01 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:02.836575 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-28be9971-a22b-4a98-bbed-a2d1a4c89941 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:02.837822 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-28be9971-a22b-4a98-bbed-a2d1a4c89941 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:02.845497 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-28be9971-a22b-4a98-bbed-a2d1a4c89941 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:02.846547 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-28be9971-a22b-4a98-bbed-a2d1a4c89941 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:02.847915 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-28be9971-a22b-4a98-bbed-a2d1a4c89941 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:02.848739 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-28be9971-a22b-4a98-bbed-a2d1a4c89941 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:02.883941 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-28be9971-a22b-4a98-bbed-a2d1a4c89941 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053416 Jan 28 01:01:02.884505 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 527/1084] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 01:01:02 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:01:03.196587 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4e3d58c7-6ee4-44ca-98de-bface3a48e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-855010018", "imageRef": "7fe09c59-2ff9-4639-b39d-9a474e83ad91", "flavorRef": "452", "networks": [{"uuid": "24e25033-acbb-46d6-9923-f2b3f53599d8"}]}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:03.254996 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.network.neutron [None req-4e3d58c7-6ee4-44ca-98de-bface3a48e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] validate_networks() for [('24e25033-acbb-46d6-9923-f2b3f53599d8', None, None, None, None, None)] {{(pid=127862) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:01:03.894837 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-4e3d58c7-6ee4-44ca-98de-bface3a48e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Flavor limits 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:01:03.895297 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-4e3d58c7-6ee4-44ca-98de-bface3a48e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Image limits 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:01:03.895786 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-4e3d58c7-6ee4-44ca-98de-bface3a48e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Flavor pref 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:01:03.896205 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-4e3d58c7-6ee4-44ca-98de-bface3a48e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Image pref 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:01:03.896894 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-4e3d58c7-6ee4-44ca-98de-bface3a48e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:01:03.907023 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4e3d58c7-6ee4-44ca-98de-bface3a48e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:03.907521 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4e3d58c7-6ee4-44ca-98de-bface3a48e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:03.908366 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4e3d58c7-6ee4-44ca-98de-bface3a48e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:03.910620 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4e3d58c7-6ee4-44ca-98de-bface3a48e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:03.939191 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-4e3d58c7-6ee4-44ca-98de-bface3a48e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Getting quotas for project 8ac4f28c68b8487191e2129b9764168c. Resources: {'instances', 'cores', 'ram'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:01:03.943396 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-4e3d58c7-6ee4-44ca-98de-bface3a48e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Getting quotas for user 1e102510ea4043db92408769929a2884 and project 8ac4f28c68b8487191e2129b9764168c. Resources: {'instances', 'cores', 'ram'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:01:03.954280 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4e3d58c7-6ee4-44ca-98de-bface3a48e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Going to run 1 instances... {{(pid=127862) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:01:03.956687 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4e3d58c7-6ee4-44ca-98de-bface3a48e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fe09c59-2ff9-4639-b39d-9a474e83ad91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:01:04.006270 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4e3d58c7-6ee4-44ca-98de-bface3a48e30 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813248 Jan 28 01:01:04.007543 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 558/1085] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 01:01:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:01:04.023768 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b25af6e2-3c35-4806-b89c-4f874ed43618 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:04.025154 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b25af6e2-3c35-4806-b89c-4f874ed43618 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:04.102432 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b25af6e2-3c35-4806-b89c-4f874ed43618 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:04.110561 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b25af6e2-3c35-4806-b89c-4f874ed43618 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4" status: 200 len: 1217 microversion: 2.1 time: 0.094341 Jan 28 01:01:04.111160 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 528/1086] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:04 2022] GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:05.128372 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-89ecc8b4-47bc-40a6-812b-60f5694b3781 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:05.128928 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-89ecc8b4-47bc-40a6-812b-60f5694b3781 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:05.134974 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-89ecc8b4-47bc-40a6-812b-60f5694b3781 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:05.135474 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-89ecc8b4-47bc-40a6-812b-60f5694b3781 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:05.136305 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-89ecc8b4-47bc-40a6-812b-60f5694b3781 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:05.136774 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-89ecc8b4-47bc-40a6-812b-60f5694b3781 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:05.213255 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-89ecc8b4-47bc-40a6-812b-60f5694b3781 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:05.221567 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-89ecc8b4-47bc-40a6-812b-60f5694b3781 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4" status: 200 len: 1269 microversion: 2.1 time: 0.097674 Jan 28 01:01:05.222181 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 559/1087] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:05 2022] GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 => generated 1269 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:06.239417 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-9833d896-cde4-40e5-a2b9-9c14f036b823 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:06.240203 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-9833d896-cde4-40e5-a2b9-9c14f036b823 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:06.247469 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9833d896-cde4-40e5-a2b9-9c14f036b823 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:06.249169 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9833d896-cde4-40e5-a2b9-9c14f036b823 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:06.250186 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9833d896-cde4-40e5-a2b9-9c14f036b823 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:06.250802 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9833d896-cde4-40e5-a2b9-9c14f036b823 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:06.409712 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-9833d896-cde4-40e5-a2b9-9c14f036b823 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:06.424309 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-9833d896-cde4-40e5-a2b9-9c14f036b823 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4" status: 200 len: 1317 microversion: 2.1 time: 0.188138 Jan 28 01:01:06.425395 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 529/1088] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:06 2022] GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:06.806076 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-534ec39d-29e8-405a-bb62-33259f42a756 req-cf88cae7-25ee-4486-9955-6450971114ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4", "tag": "acafeee4-364c-47c3-8b5c-6e5ed586a825"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:06.808207 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:06.808207 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 01:01:06.818903 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-534ec39d-29e8-405a-bb62-33259f42a756 req-cf88cae7-25ee-4486-9955-6450971114ce service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:06.819510 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-534ec39d-29e8-405a-bb62-33259f42a756 req-cf88cae7-25ee-4486-9955-6450971114ce service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:06.834068 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-534ec39d-29e8-405a-bb62-33259f42a756 req-cf88cae7-25ee-4486-9955-6450971114ce service nova] Creating event network-changed:acafeee4-364c-47c3-8b5c-6e5ed586a825 for instance f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 on hv-cinder-80952 Jan 28 01:01:06.839195 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-534ec39d-29e8-405a-bb62-33259f42a756 req-cf88cae7-25ee-4486-9955-6450971114ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036648 Jan 28 01:01:06.839779 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 560/1089] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:07.452138 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-ced7bfff-7517-4f8f-8b11-97e383d98f3d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:07.453255 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-ced7bfff-7517-4f8f-8b11-97e383d98f3d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:07.461176 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ced7bfff-7517-4f8f-8b11-97e383d98f3d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:07.461639 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ced7bfff-7517-4f8f-8b11-97e383d98f3d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:07.462440 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ced7bfff-7517-4f8f-8b11-97e383d98f3d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:07.462882 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-ced7bfff-7517-4f8f-8b11-97e383d98f3d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:07.602766 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-ced7bfff-7517-4f8f-8b11-97e383d98f3d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:07.611309 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-ced7bfff-7517-4f8f-8b11-97e383d98f3d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4" status: 200 len: 1317 microversion: 2.1 time: 0.163545 Jan 28 01:01:07.611902 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 530/1090] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:07 2022] GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:08.629030 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1f527e34-35da-4d24-a753-23f49d8918af tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:08.629731 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1f527e34-35da-4d24-a753-23f49d8918af tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:08.636115 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1f527e34-35da-4d24-a753-23f49d8918af tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:08.636576 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1f527e34-35da-4d24-a753-23f49d8918af tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:08.637380 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1f527e34-35da-4d24-a753-23f49d8918af tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:08.637825 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1f527e34-35da-4d24-a753-23f49d8918af tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:08.777969 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-1f527e34-35da-4d24-a753-23f49d8918af tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:08.786418 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1f527e34-35da-4d24-a753-23f49d8918af tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4" status: 200 len: 1317 microversion: 2.1 time: 0.161968 Jan 28 01:01:08.787003 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 561/1091] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:08 2022] GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:09.802871 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b2f20779-63b4-4a54-9a89-b61e5059af57 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:09.803509 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b2f20779-63b4-4a54-9a89-b61e5059af57 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:09.809785 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b2f20779-63b4-4a54-9a89-b61e5059af57 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:09.810246 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b2f20779-63b4-4a54-9a89-b61e5059af57 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:09.811028 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b2f20779-63b4-4a54-9a89-b61e5059af57 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:09.811506 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b2f20779-63b4-4a54-9a89-b61e5059af57 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:09.942461 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b2f20779-63b4-4a54-9a89-b61e5059af57 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:09.949763 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b2f20779-63b4-4a54-9a89-b61e5059af57 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4" status: 200 len: 1317 microversion: 2.1 time: 0.150563 Jan 28 01:01:09.950328 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 531/1092] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:09 2022] GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:10.967355 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-43698655-afba-41eb-bcf5-8ce010a9604e tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:10.968022 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-43698655-afba-41eb-bcf5-8ce010a9604e tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:10.975251 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-43698655-afba-41eb-bcf5-8ce010a9604e tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:10.975758 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-43698655-afba-41eb-bcf5-8ce010a9604e tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:10.976680 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-43698655-afba-41eb-bcf5-8ce010a9604e tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:10.977012 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-43698655-afba-41eb-bcf5-8ce010a9604e tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:11.113285 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-43698655-afba-41eb-bcf5-8ce010a9604e tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:11.120608 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-43698655-afba-41eb-bcf5-8ce010a9604e tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4" status: 200 len: 1317 microversion: 2.1 time: 0.156955 Jan 28 01:01:11.121171 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 562/1093] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:10 2022] GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:12.137679 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f354e92c-d1a6-42df-8cea-537bbe7096ce tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:12.138222 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f354e92c-d1a6-42df-8cea-537bbe7096ce tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:12.145487 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f354e92c-d1a6-42df-8cea-537bbe7096ce tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:12.145930 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f354e92c-d1a6-42df-8cea-537bbe7096ce tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:12.146987 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f354e92c-d1a6-42df-8cea-537bbe7096ce tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:12.147456 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f354e92c-d1a6-42df-8cea-537bbe7096ce tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:12.286188 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f354e92c-d1a6-42df-8cea-537bbe7096ce tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:12.294225 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f354e92c-d1a6-42df-8cea-537bbe7096ce tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4" status: 200 len: 1317 microversion: 2.1 time: 0.160381 Jan 28 01:01:12.294803 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 532/1094] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:12 2022] GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:12.834860 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-50f84b6c-8c02-48c9-a754-77602fbbe9a8 req-68f00422-5a2b-4709-b6f4-468d8ec3c798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4", "name": "network-vif-plugged", "status": "completed", "tag": "acafeee4-364c-47c3-8b5c-6e5ed586a825"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:12.837048 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:12.837048 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 01:01:12.844589 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-50f84b6c-8c02-48c9-a754-77602fbbe9a8 req-68f00422-5a2b-4709-b6f4-468d8ec3c798 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:12.845035 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-50f84b6c-8c02-48c9-a754-77602fbbe9a8 req-68f00422-5a2b-4709-b6f4-468d8ec3c798 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:12.856889 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-50f84b6c-8c02-48c9-a754-77602fbbe9a8 req-68f00422-5a2b-4709-b6f4-468d8ec3c798 service nova] Creating event network-vif-plugged:acafeee4-364c-47c3-8b5c-6e5ed586a825 for instance f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 on hv-cinder-80952 Jan 28 01:01:12.861978 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-50f84b6c-8c02-48c9-a754-77602fbbe9a8 req-68f00422-5a2b-4709-b6f4-468d8ec3c798 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031289 Jan 28 01:01:12.862581 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 563/1095] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:13.311288 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2b47fae7-f7f9-4195-a8bd-c7fb7e4b4bd9 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:13.312513 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2b47fae7-f7f9-4195-a8bd-c7fb7e4b4bd9 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:13.319864 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2b47fae7-f7f9-4195-a8bd-c7fb7e4b4bd9 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:13.320315 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2b47fae7-f7f9-4195-a8bd-c7fb7e4b4bd9 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:13.321109 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2b47fae7-f7f9-4195-a8bd-c7fb7e4b4bd9 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:13.321544 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2b47fae7-f7f9-4195-a8bd-c7fb7e4b4bd9 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:13.458631 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-2b47fae7-f7f9-4195-a8bd-c7fb7e4b4bd9 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:13.466051 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2b47fae7-f7f9-4195-a8bd-c7fb7e4b4bd9 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4" status: 200 len: 1317 microversion: 2.1 time: 0.158449 Jan 28 01:01:13.466638 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 533/1096] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:13 2022] GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:14.485108 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9d9a0ef7-a98c-4408-8d40-5f1979b06487 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:14.485830 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9d9a0ef7-a98c-4408-8d40-5f1979b06487 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:14.492021 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d9a0ef7-a98c-4408-8d40-5f1979b06487 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:14.492486 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d9a0ef7-a98c-4408-8d40-5f1979b06487 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:14.493292 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d9a0ef7-a98c-4408-8d40-5f1979b06487 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:14.493744 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d9a0ef7-a98c-4408-8d40-5f1979b06487 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:14.629542 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9d9a0ef7-a98c-4408-8d40-5f1979b06487 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:14.637084 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9d9a0ef7-a98c-4408-8d40-5f1979b06487 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4" status: 200 len: 1317 microversion: 2.1 time: 0.157224 Jan 28 01:01:14.637717 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 564/1097] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:14 2022] GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:15.657355 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-50ba0139-e28b-4fa2-b947-0622698ee7fe tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:15.657997 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-50ba0139-e28b-4fa2-b947-0622698ee7fe tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:15.664539 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-50ba0139-e28b-4fa2-b947-0622698ee7fe tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:15.664991 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-50ba0139-e28b-4fa2-b947-0622698ee7fe tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:15.665779 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-50ba0139-e28b-4fa2-b947-0622698ee7fe tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:15.666219 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-50ba0139-e28b-4fa2-b947-0622698ee7fe tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:15.799996 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-50ba0139-e28b-4fa2-b947-0622698ee7fe tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:15.807237 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-50ba0139-e28b-4fa2-b947-0622698ee7fe tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4" status: 200 len: 1507 microversion: 2.1 time: 0.154706 Jan 28 01:01:15.807823 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 534/1098] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:15 2022] GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:17.125502 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-6fdd7d9e-a000-430b-815b-1c5b8cb6feba tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6815a0d3-482a-4b03-be44-e185f5bb3da8"}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:17.126688 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-6fdd7d9e-a000-430b-815b-1c5b8cb6feba tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:17.133659 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6fdd7d9e-a000-430b-815b-1c5b8cb6feba tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:17.134121 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6fdd7d9e-a000-430b-815b-1c5b8cb6feba tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:17.134933 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6fdd7d9e-a000-430b-815b-1c5b8cb6feba tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:17.135420 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6fdd7d9e-a000-430b-815b-1c5b8cb6feba tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:17.419589 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-6fdd7d9e-a000-430b-815b-1c5b8cb6feba tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "POST /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298111 Jan 28 01:01:17.420763 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 565/1099] 10.222.0.25 () {60 vars in 1322 bytes} [Fri Jan 28 01:01:17 2022] POST /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:01:25.009846 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5244896d-00fe-4f9a-a80e-bd01b830ba4a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:25.010709 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5244896d-00fe-4f9a-a80e-bd01b830ba4a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:25.018722 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5244896d-00fe-4f9a-a80e-bd01b830ba4a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:25.019706 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5244896d-00fe-4f9a-a80e-bd01b830ba4a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:25.021084 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5244896d-00fe-4f9a-a80e-bd01b830ba4a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:25.021853 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5244896d-00fe-4f9a-a80e-bd01b830ba4a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:25.100544 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.objects.instance [None req-5244896d-00fe-4f9a-a80e-bd01b830ba4a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lazy-loading 'services' on Instance uuid f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 {{(pid=127863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:01:25.168259 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5244896d-00fe-4f9a-a80e-bd01b830ba4a tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4/os-volume_attachments/6815a0d3-482a-4b03-be44-e185f5bb3da8" status: 202 len: 0 microversion: 2.1 time: 0.162116 Jan 28 01:01:25.168899 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 535/1100] 10.222.0.25 () {58 vars in 1415 bytes} [Fri Jan 28 01:01:25 2022] DELETE /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4/os-volume_attachments/6815a0d3-482a-4b03-be44-e185f5bb3da8 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:01:25.178199 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-785b1715-bbdc-4cad-91c8-8fda5dc0cfc8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:25.179344 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-785b1715-bbdc-4cad-91c8-8fda5dc0cfc8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:25.186056 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-785b1715-bbdc-4cad-91c8-8fda5dc0cfc8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:25.186522 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-785b1715-bbdc-4cad-91c8-8fda5dc0cfc8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:25.188085 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-785b1715-bbdc-4cad-91c8-8fda5dc0cfc8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:25.188606 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-785b1715-bbdc-4cad-91c8-8fda5dc0cfc8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:25.219453 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-785b1715-bbdc-4cad-91c8-8fda5dc0cfc8 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045188 Jan 28 01:01:25.220040 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 566/1101] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 01:01:25 2022] GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:26.232463 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-897c7e18-a38d-409d-8f67-09d2230017f0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:26.233601 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-897c7e18-a38d-409d-8f67-09d2230017f0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:26.240299 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-897c7e18-a38d-409d-8f67-09d2230017f0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:26.240753 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-897c7e18-a38d-409d-8f67-09d2230017f0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:26.241539 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-897c7e18-a38d-409d-8f67-09d2230017f0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:26.241978 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-897c7e18-a38d-409d-8f67-09d2230017f0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:26.271787 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-897c7e18-a38d-409d-8f67-09d2230017f0 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044215 Jan 28 01:01:26.272719 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 536/1102] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 01:01:26 2022] GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:27.284186 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-823392f8-c9ee-4747-a2ec-707d6229f570 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:27.285104 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-823392f8-c9ee-4747-a2ec-707d6229f570 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:27.291634 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-823392f8-c9ee-4747-a2ec-707d6229f570 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:27.292084 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-823392f8-c9ee-4747-a2ec-707d6229f570 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:27.292879 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-823392f8-c9ee-4747-a2ec-707d6229f570 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:27.293323 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-823392f8-c9ee-4747-a2ec-707d6229f570 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:27.323704 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-823392f8-c9ee-4747-a2ec-707d6229f570 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043737 Jan 28 01:01:27.324262 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 567/1103] 10.222.0.25 () {58 vars in 1301 bytes} [Fri Jan 28 01:01:27 2022] GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:01:28.509837 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-08324090-6991-4fa8-a666-b24db8e7269d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:28.510457 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-08324090-6991-4fa8-a666-b24db8e7269d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:28.517809 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-08324090-6991-4fa8-a666-b24db8e7269d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:28.518266 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-08324090-6991-4fa8-a666-b24db8e7269d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:28.519059 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-08324090-6991-4fa8-a666-b24db8e7269d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:28.519533 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-08324090-6991-4fa8-a666-b24db8e7269d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:28.544714 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-08324090-6991-4fa8-a666-b24db8e7269d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Going to try to terminate instance {{(pid=127863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:01:28.618194 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-08324090-6991-4fa8-a666-b24db8e7269d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4" status: 204 len: 0 microversion: 2.1 time: 0.111788 Jan 28 01:01:28.618782 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 537/1104] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 01:01:28 2022] DELETE /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:01:28.628089 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-6e161bc3-c732-4151-bd49-d67196bfaa94 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:28.628677 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-6e161bc3-c732-4151-bd49-d67196bfaa94 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:28.634924 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6e161bc3-c732-4151-bd49-d67196bfaa94 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:28.635420 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6e161bc3-c732-4151-bd49-d67196bfaa94 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:28.636231 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6e161bc3-c732-4151-bd49-d67196bfaa94 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:28.636659 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6e161bc3-c732-4151-bd49-d67196bfaa94 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:28.770052 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-6e161bc3-c732-4151-bd49-d67196bfaa94 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:28.777950 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-6e161bc3-c732-4151-bd49-d67196bfaa94 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4" status: 200 len: 1513 microversion: 2.1 time: 0.154625 Jan 28 01:01:28.778705 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 568/1105] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:28 2022] GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:29.795088 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5cd8b5e5-bb2e-47fa-97d0-224bafafb0f2 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:29.795810 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5cd8b5e5-bb2e-47fa-97d0-224bafafb0f2 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:29.802052 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5cd8b5e5-bb2e-47fa-97d0-224bafafb0f2 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:29.802504 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5cd8b5e5-bb2e-47fa-97d0-224bafafb0f2 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:29.803289 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5cd8b5e5-bb2e-47fa-97d0-224bafafb0f2 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:29.803733 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5cd8b5e5-bb2e-47fa-97d0-224bafafb0f2 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:29.934875 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-5cd8b5e5-bb2e-47fa-97d0-224bafafb0f2 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:29.943738 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5cd8b5e5-bb2e-47fa-97d0-224bafafb0f2 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4" status: 200 len: 1513 microversion: 2.1 time: 0.152347 Jan 28 01:01:29.944465 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 538/1106] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:29 2022] GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:30.961933 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f361fc22-9046-4def-92e5-3085b2951a01 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:30.962540 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f361fc22-9046-4def-92e5-3085b2951a01 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:30.969751 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f361fc22-9046-4def-92e5-3085b2951a01 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:30.970205 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f361fc22-9046-4def-92e5-3085b2951a01 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:30.971027 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f361fc22-9046-4def-92e5-3085b2951a01 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:30.971498 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f361fc22-9046-4def-92e5-3085b2951a01 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:31.105689 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f361fc22-9046-4def-92e5-3085b2951a01 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:31.114108 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f361fc22-9046-4def-92e5-3085b2951a01 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4" status: 200 len: 1513 microversion: 2.1 time: 0.155898 Jan 28 01:01:31.114728 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 569/1107] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:30 2022] GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:31.535941 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-f2a97be5-6b3b-479a-92f6-755bb4e3bebb req-86cdad65-dc1a-4cae-89dc-4e50d6cdf375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4", "name": "network-vif-deleted", "tag": "acafeee4-364c-47c3-8b5c-6e5ed586a825"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:31.538105 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:31.538105 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 01:01:31.547345 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-f2a97be5-6b3b-479a-92f6-755bb4e3bebb req-86cdad65-dc1a-4cae-89dc-4e50d6cdf375 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:31.547798 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-f2a97be5-6b3b-479a-92f6-755bb4e3bebb req-86cdad65-dc1a-4cae-89dc-4e50d6cdf375 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:31.560883 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-f2a97be5-6b3b-479a-92f6-755bb4e3bebb req-86cdad65-dc1a-4cae-89dc-4e50d6cdf375 service nova] Creating event network-vif-deleted:acafeee4-364c-47c3-8b5c-6e5ed586a825 for instance f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 on hv-cinder-80952 Jan 28 01:01:31.567559 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-f2a97be5-6b3b-479a-92f6-755bb4e3bebb req-86cdad65-dc1a-4cae-89dc-4e50d6cdf375 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035418 Jan 28 01:01:31.568735 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 539/1108] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:32.131530 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-0c6528a7-977f-4837-96ed-5945926f695f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:32.132400 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-0c6528a7-977f-4837-96ed-5945926f695f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:32.140011 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0c6528a7-977f-4837-96ed-5945926f695f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:32.140918 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0c6528a7-977f-4837-96ed-5945926f695f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:32.141972 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0c6528a7-977f-4837-96ed-5945926f695f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:32.142419 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-0c6528a7-977f-4837-96ed-5945926f695f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:32.158134 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-0c6528a7-977f-4837-96ed-5945926f695f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] HTTP exception thrown: Instance f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 could not be found. Jan 28 01:01:32.158733 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-0c6528a7-977f-4837-96ed-5945926f695f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Returning 404 to user: Instance f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:01:32.159611 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-0c6528a7-977f-4837-96ed-5945926f695f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4" status: 404 len: 111 microversion: 2.1 time: 0.032288 Jan 28 01:01:32.160170 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 570/1109] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:32 2022] GET /compute/v2.1/servers/f9b2d413-efc0-4ed6-82d5-2c0cbe7d81b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:01:33.292938 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-9704a38e-52c3-47aa-80fa-8c2e37dd3601 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:33.293519 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-9704a38e-52c3-47aa-80fa-8c2e37dd3601 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:33.300919 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9704a38e-52c3-47aa-80fa-8c2e37dd3601 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:33.301421 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9704a38e-52c3-47aa-80fa-8c2e37dd3601 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:33.302216 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9704a38e-52c3-47aa-80fa-8c2e37dd3601 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:33.302653 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-9704a38e-52c3-47aa-80fa-8c2e37dd3601 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:33.327592 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-9704a38e-52c3-47aa-80fa-8c2e37dd3601 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Going to try to terminate instance {{(pid=127863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:01:33.407351 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-9704a38e-52c3-47aa-80fa-8c2e37dd3601 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "DELETE /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 204 len: 0 microversion: 2.1 time: 0.118055 Jan 28 01:01:33.408011 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 540/1110] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 01:01:33 2022] DELETE /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:01:33.416036 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-abeda041-88b0-4c04-8df4-a1d07416551d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:33.416609 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-abeda041-88b0-4c04-8df4-a1d07416551d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:33.423763 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-abeda041-88b0-4c04-8df4-a1d07416551d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:33.424225 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-abeda041-88b0-4c04-8df4-a1d07416551d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:33.425159 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-abeda041-88b0-4c04-8df4-a1d07416551d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:33.425607 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-abeda041-88b0-4c04-8df4-a1d07416551d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:33.564513 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-abeda041-88b0-4c04-8df4-a1d07416551d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:33.572103 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-abeda041-88b0-4c04-8df4-a1d07416551d tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1513 microversion: 2.1 time: 0.159743 Jan 28 01:01:33.572682 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 571/1111] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:33 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:34.589760 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-6b9088b2-d050-4073-9c0a-a95ff9838928 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:34.590450 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-6b9088b2-d050-4073-9c0a-a95ff9838928 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:34.597459 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6b9088b2-d050-4073-9c0a-a95ff9838928 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:34.597910 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6b9088b2-d050-4073-9c0a-a95ff9838928 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:34.598688 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6b9088b2-d050-4073-9c0a-a95ff9838928 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:34.599124 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6b9088b2-d050-4073-9c0a-a95ff9838928 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:34.738807 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-6b9088b2-d050-4073-9c0a-a95ff9838928 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:34.746861 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-6b9088b2-d050-4073-9c0a-a95ff9838928 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1513 microversion: 2.1 time: 0.161056 Jan 28 01:01:34.747466 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 541/1112] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:34 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:35.764253 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d28c316a-a718-4bc5-8377-90a568829969 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:35.764874 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d28c316a-a718-4bc5-8377-90a568829969 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:35.772120 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d28c316a-a718-4bc5-8377-90a568829969 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:35.772830 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d28c316a-a718-4bc5-8377-90a568829969 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:35.773647 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d28c316a-a718-4bc5-8377-90a568829969 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:35.774098 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d28c316a-a718-4bc5-8377-90a568829969 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:35.915145 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d28c316a-a718-4bc5-8377-90a568829969 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:35.923753 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d28c316a-a718-4bc5-8377-90a568829969 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 200 len: 1513 microversion: 2.1 time: 0.163139 Jan 28 01:01:35.927384 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 572/1113] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:35 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:35.969362 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-bfdba6ef-6a54-481a-b5bc-76a7eb6ecabe req-b5c7dec6-4ac2-4bd8-b193-841a311e5e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846938ed-7651-44a3-8db6-ae8b9a80ca1a", "name": "network-vif-deleted", "tag": "fbcec141-aef9-4841-b5c0-4a95c625680b"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:35.971154 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:35.971154 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 01:01:35.980578 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-bfdba6ef-6a54-481a-b5bc-76a7eb6ecabe req-b5c7dec6-4ac2-4bd8-b193-841a311e5e0d service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:35.980946 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-bfdba6ef-6a54-481a-b5bc-76a7eb6ecabe req-b5c7dec6-4ac2-4bd8-b193-841a311e5e0d service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:35.993249 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-bfdba6ef-6a54-481a-b5bc-76a7eb6ecabe req-b5c7dec6-4ac2-4bd8-b193-841a311e5e0d service nova] Creating event network-vif-deleted:fbcec141-aef9-4841-b5c0-4a95c625680b for instance 846938ed-7651-44a3-8db6-ae8b9a80ca1a on hv-cinder-80952 Jan 28 01:01:35.999426 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-bfdba6ef-6a54-481a-b5bc-76a7eb6ecabe req-b5c7dec6-4ac2-4bd8-b193-841a311e5e0d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034820 Jan 28 01:01:36.001173 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 542/1114] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:36.941313 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-32cb20ce-8376-4913-9452-f23474f62d79 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:36.941979 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-32cb20ce-8376-4913-9452-f23474f62d79 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: 846938ed-7651-44a3-8db6-ae8b9a80ca1a] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:36.948419 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-32cb20ce-8376-4913-9452-f23474f62d79 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:36.948898 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-32cb20ce-8376-4913-9452-f23474f62d79 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:36.949677 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-32cb20ce-8376-4913-9452-f23474f62d79 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:36.950123 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-32cb20ce-8376-4913-9452-f23474f62d79 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:36.964329 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-32cb20ce-8376-4913-9452-f23474f62d79 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] HTTP exception thrown: Instance 846938ed-7651-44a3-8db6-ae8b9a80ca1a could not be found. Jan 28 01:01:36.964924 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-32cb20ce-8376-4913-9452-f23474f62d79 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Returning 404 to user: Instance 846938ed-7651-44a3-8db6-ae8b9a80ca1a could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:01:36.965760 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-32cb20ce-8376-4913-9452-f23474f62d79 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a" status: 404 len: 111 microversion: 2.1 time: 0.028852 Jan 28 01:01:36.966306 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 573/1115] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:36 2022] GET /compute/v2.1/servers/846938ed-7651-44a3-8db6-ae8b9a80ca1a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:01:36.975185 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5e01900c-5009-4c6b-9fac-2823c7dabd55 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:36.975843 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5e01900c-5009-4c6b-9fac-2823c7dabd55 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: efac69d4-1999-4729-a1f5-2242cc25f097] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:36.982631 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5e01900c-5009-4c6b-9fac-2823c7dabd55 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:36.983095 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5e01900c-5009-4c6b-9fac-2823c7dabd55 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:36.983945 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5e01900c-5009-4c6b-9fac-2823c7dabd55 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:36.983945 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5e01900c-5009-4c6b-9fac-2823c7dabd55 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:37.014549 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5e01900c-5009-4c6b-9fac-2823c7dabd55 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: efac69d4-1999-4729-a1f5-2242cc25f097] Going to try to terminate instance {{(pid=127863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:01:37.090996 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5e01900c-5009-4c6b-9fac-2823c7dabd55 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "DELETE /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097" status: 204 len: 0 microversion: 2.1 time: 0.119623 Jan 28 01:01:37.091760 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 543/1116] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 01:01:36 2022] DELETE /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:01:37.099937 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-2f71e394-6477-4afd-93af-fe9ff3ea1d22 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:37.100550 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-2f71e394-6477-4afd-93af-fe9ff3ea1d22 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: efac69d4-1999-4729-a1f5-2242cc25f097] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:37.107013 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2f71e394-6477-4afd-93af-fe9ff3ea1d22 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:37.107554 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2f71e394-6477-4afd-93af-fe9ff3ea1d22 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:37.108358 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2f71e394-6477-4afd-93af-fe9ff3ea1d22 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:37.108808 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2f71e394-6477-4afd-93af-fe9ff3ea1d22 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:37.242263 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-2f71e394-6477-4afd-93af-fe9ff3ea1d22 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:37.250343 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-2f71e394-6477-4afd-93af-fe9ff3ea1d22 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097" status: 200 len: 1514 microversion: 2.1 time: 0.153996 Jan 28 01:01:37.250920 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 574/1117] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:37 2022] GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:38.268832 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4f23537d-9133-49dd-aedd-e9da6d81c651 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:38.269537 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4f23537d-9133-49dd-aedd-e9da6d81c651 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: efac69d4-1999-4729-a1f5-2242cc25f097] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:38.276199 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f23537d-9133-49dd-aedd-e9da6d81c651 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:38.276658 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f23537d-9133-49dd-aedd-e9da6d81c651 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:38.277448 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f23537d-9133-49dd-aedd-e9da6d81c651 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:38.277889 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f23537d-9133-49dd-aedd-e9da6d81c651 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:38.421046 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4f23537d-9133-49dd-aedd-e9da6d81c651 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:38.429135 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4f23537d-9133-49dd-aedd-e9da6d81c651 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097" status: 200 len: 1514 microversion: 2.1 time: 0.165281 Jan 28 01:01:38.429712 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 544/1118] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:38 2022] GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:39.335802 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-0acf3b0b-f6cc-48c5-a16f-22287616f0e6 req-f5b98192-df3f-4db2-81e7-d2667ec081c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efac69d4-1999-4729-a1f5-2242cc25f097", "name": "network-vif-deleted", "tag": "dbf5e345-a1ef-4155-bf0c-8b9b60c3f7c3"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:39.337500 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:39.337500 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 01:01:39.345809 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-0acf3b0b-f6cc-48c5-a16f-22287616f0e6 req-f5b98192-df3f-4db2-81e7-d2667ec081c5 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:39.346566 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-0acf3b0b-f6cc-48c5-a16f-22287616f0e6 req-f5b98192-df3f-4db2-81e7-d2667ec081c5 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:39.367637 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-0acf3b0b-f6cc-48c5-a16f-22287616f0e6 req-f5b98192-df3f-4db2-81e7-d2667ec081c5 service nova] Creating event network-vif-deleted:dbf5e345-a1ef-4155-bf0c-8b9b60c3f7c3 for instance efac69d4-1999-4729-a1f5-2242cc25f097 on hv-cinder-80952 Jan 28 01:01:39.374330 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-0acf3b0b-f6cc-48c5-a16f-22287616f0e6 req-f5b98192-df3f-4db2-81e7-d2667ec081c5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042068 Jan 28 01:01:39.375980 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 575/1119] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:39.446482 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7a9e31d9-21d1-4089-8fe6-ac9660036c2f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:39.447122 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7a9e31d9-21d1-4089-8fe6-ac9660036c2f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: efac69d4-1999-4729-a1f5-2242cc25f097] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:39.454787 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7a9e31d9-21d1-4089-8fe6-ac9660036c2f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:39.455312 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7a9e31d9-21d1-4089-8fe6-ac9660036c2f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:39.456236 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7a9e31d9-21d1-4089-8fe6-ac9660036c2f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:39.456689 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7a9e31d9-21d1-4089-8fe6-ac9660036c2f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:39.491491 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7a9e31d9-21d1-4089-8fe6-ac9660036c2f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:39.491947 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7a9e31d9-21d1-4089-8fe6-ac9660036c2f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:39.492412 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.objects.instance [None req-7a9e31d9-21d1-4089-8fe6-ac9660036c2f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lazy-loading 'fault' on Instance uuid efac69d4-1999-4729-a1f5-2242cc25f097 {{(pid=127863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:01:39.535807 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7a9e31d9-21d1-4089-8fe6-ac9660036c2f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:39.543304 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7a9e31d9-21d1-4089-8fe6-ac9660036c2f tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097" status: 200 len: 1308 microversion: 2.1 time: 0.100988 Jan 28 01:01:39.543879 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 545/1120] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:39 2022] GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:40.560889 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3ff2ab98-eff5-421b-a584-b74384c2b971 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:40.561586 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3ff2ab98-eff5-421b-a584-b74384c2b971 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: efac69d4-1999-4729-a1f5-2242cc25f097] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:40.568579 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3ff2ab98-eff5-421b-a584-b74384c2b971 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:40.569030 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3ff2ab98-eff5-421b-a584-b74384c2b971 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:40.569825 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3ff2ab98-eff5-421b-a584-b74384c2b971 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:40.570263 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3ff2ab98-eff5-421b-a584-b74384c2b971 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:40.583732 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-3ff2ab98-eff5-421b-a584-b74384c2b971 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] HTTP exception thrown: Instance efac69d4-1999-4729-a1f5-2242cc25f097 could not be found. Jan 28 01:01:40.584324 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3ff2ab98-eff5-421b-a584-b74384c2b971 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Returning 404 to user: Instance efac69d4-1999-4729-a1f5-2242cc25f097 could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:01:40.585151 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3ff2ab98-eff5-421b-a584-b74384c2b971 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097" status: 404 len: 111 microversion: 2.1 time: 0.028811 Jan 28 01:01:40.585698 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 576/1121] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:40 2022] GET /compute/v2.1/servers/efac69d4-1999-4729-a1f5-2242cc25f097 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:01:41.715084 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f3fe032a-079f-4869-9fb1-4aacf2bc8a74 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:41.716116 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f3fe032a-079f-4869-9fb1-4aacf2bc8a74 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:41.723093 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f3fe032a-079f-4869-9fb1-4aacf2bc8a74 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:41.723571 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f3fe032a-079f-4869-9fb1-4aacf2bc8a74 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:41.724502 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f3fe032a-079f-4869-9fb1-4aacf2bc8a74 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:41.724941 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f3fe032a-079f-4869-9fb1-4aacf2bc8a74 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:41.752347 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f3fe032a-079f-4869-9fb1-4aacf2bc8a74 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Going to try to terminate instance {{(pid=127863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:01:41.832809 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f3fe032a-079f-4869-9fb1-4aacf2bc8a74 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3" status: 204 len: 0 microversion: 2.1 time: 0.121013 Jan 28 01:01:41.833425 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 546/1122] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 01:01:41 2022] DELETE /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 01:01:41.847639 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-687e484b-95e6-477d-8f4c-c34c9b03423e tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:41.848264 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-687e484b-95e6-477d-8f4c-c34c9b03423e tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:41.855216 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-687e484b-95e6-477d-8f4c-c34c9b03423e tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:41.855704 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-687e484b-95e6-477d-8f4c-c34c9b03423e tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:41.856501 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-687e484b-95e6-477d-8f4c-c34c9b03423e tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:41.856940 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-687e484b-95e6-477d-8f4c-c34c9b03423e tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:42.001603 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-687e484b-95e6-477d-8f4c-c34c9b03423e tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:42.009886 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-687e484b-95e6-477d-8f4c-c34c9b03423e tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3" status: 200 len: 1514 microversion: 2.1 time: 0.172149 Jan 28 01:01:42.010597 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 577/1123] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:41 2022] GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:01:43.029670 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7ebc5280-a46f-4f48-b236-c5753297d2f5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:43.030371 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7ebc5280-a46f-4f48-b236-c5753297d2f5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:43.037414 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7ebc5280-a46f-4f48-b236-c5753297d2f5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:43.037873 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7ebc5280-a46f-4f48-b236-c5753297d2f5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:43.038660 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7ebc5280-a46f-4f48-b236-c5753297d2f5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:43.039111 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7ebc5280-a46f-4f48-b236-c5753297d2f5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:43.173569 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7ebc5280-a46f-4f48-b236-c5753297d2f5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:43.181027 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7ebc5280-a46f-4f48-b236-c5753297d2f5 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3" status: 200 len: 1514 microversion: 2.1 time: 0.155457 Jan 28 01:01:43.181603 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 547/1124] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:43 2022] GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:44.197568 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-c6139950-60f8-47f8-9a87-8d21b0bf94d1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:44.198222 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-c6139950-60f8-47f8-9a87-8d21b0bf94d1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:44.205740 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c6139950-60f8-47f8-9a87-8d21b0bf94d1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:44.206205 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c6139950-60f8-47f8-9a87-8d21b0bf94d1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:44.207085 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c6139950-60f8-47f8-9a87-8d21b0bf94d1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:44.207625 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c6139950-60f8-47f8-9a87-8d21b0bf94d1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:44.449125 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c6139950-60f8-47f8-9a87-8d21b0bf94d1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e102510ea4043db92408769929a2884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac4f28c68b8487191e2129b9764168c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:01:44.457482 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-c6139950-60f8-47f8-9a87-8d21b0bf94d1 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3" status: 200 len: 1472 microversion: 2.1 time: 0.263525 Jan 28 01:01:44.458092 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 578/1125] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:44 2022] GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3 => generated 1472 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:01:44.619303 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-066c5b87-dd8f-407c-87d9-9e3a632fafa6 req-cc57299c-3176-4f1b-b3ef-7dd031cac77a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a65c64-c2b0-41aa-94f9-733eb4541ba3", "name": "network-vif-deleted", "tag": "5b314c89-8ba0-445e-a18e-60ea472b1470"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:01:44.620925 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:01:44.620925 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 01:01:44.628703 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-066c5b87-dd8f-407c-87d9-9e3a632fafa6 req-cc57299c-3176-4f1b-b3ef-7dd031cac77a service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:44.629147 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-066c5b87-dd8f-407c-87d9-9e3a632fafa6 req-cc57299c-3176-4f1b-b3ef-7dd031cac77a service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:44.641390 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-066c5b87-dd8f-407c-87d9-9e3a632fafa6 req-cc57299c-3176-4f1b-b3ef-7dd031cac77a service nova] Creating event network-vif-deleted:5b314c89-8ba0-445e-a18e-60ea472b1470 for instance e1a65c64-c2b0-41aa-94f9-733eb4541ba3 on hv-cinder-80952 Jan 28 01:01:44.647024 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-066c5b87-dd8f-407c-87d9-9e3a632fafa6 req-cc57299c-3176-4f1b-b3ef-7dd031cac77a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031314 Jan 28 01:01:44.647650 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 548/1126] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:01:45.474519 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-2043422d-ad57-4bce-920e-65aeb6384cb7 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:01:45.475086 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-2043422d-ad57-4bce-920e-65aeb6384cb7 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] [instance: e1a65c64-c2b0-41aa-94f9-733eb4541ba3] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:01:45.481481 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2043422d-ad57-4bce-920e-65aeb6384cb7 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:45.481941 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2043422d-ad57-4bce-920e-65aeb6384cb7 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:45.482732 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2043422d-ad57-4bce-920e-65aeb6384cb7 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:01:45.483189 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-2043422d-ad57-4bce-920e-65aeb6384cb7 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:01:45.497306 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-2043422d-ad57-4bce-920e-65aeb6384cb7 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] HTTP exception thrown: Instance e1a65c64-c2b0-41aa-94f9-733eb4541ba3 could not be found. Jan 28 01:01:45.497905 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-2043422d-ad57-4bce-920e-65aeb6384cb7 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] Returning 404 to user: Instance e1a65c64-c2b0-41aa-94f9-733eb4541ba3 could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:01:45.498738 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-2043422d-ad57-4bce-920e-65aeb6384cb7 tempest-AttachVolumeNegativeTest-1138083285 tempest-AttachVolumeNegativeTest-1138083285-project] 10.222.0.25 "GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3" status: 404 len: 111 microversion: 2.1 time: 0.028049 Jan 28 01:01:45.499307 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 579/1127] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:01:45 2022] GET /compute/v2.1/servers/e1a65c64-c2b0-41aa-94f9-733eb4541ba3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 01:01:45.914539 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:01:45.915164 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: Fri Jan 28 01:01:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:02:28.896835 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-086cc53f-d1a5-4020-9681-0ecec682f577 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1794896989", "imageRef": "7fe09c59-2ff9-4639-b39d-9a474e83ad91", "flavorRef": "452"}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:29.108824 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.network.neutron [None req-086cc53f-d1a5-4020-9681-0ecec682f577 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] validate_networks() for None {{(pid=127863) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:02:29.394970 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-086cc53f-d1a5-4020-9681-0ecec682f577 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Flavor limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:02:29.395631 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-086cc53f-d1a5-4020-9681-0ecec682f577 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Image limits 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:02:29.396115 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-086cc53f-d1a5-4020-9681-0ecec682f577 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Flavor pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:02:29.396700 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-086cc53f-d1a5-4020-9681-0ecec682f577 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Image pref 0:0:0 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:02:29.397124 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.virt.hardware [None req-086cc53f-d1a5-4020-9681-0ecec682f577 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:02:29.406610 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-086cc53f-d1a5-4020-9681-0ecec682f577 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:29.407079 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-086cc53f-d1a5-4020-9681-0ecec682f577 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:29.408118 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-086cc53f-d1a5-4020-9681-0ecec682f577 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:29.408556 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-086cc53f-d1a5-4020-9681-0ecec682f577 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:29.426317 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-086cc53f-d1a5-4020-9681-0ecec682f577 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Getting quotas for project 7df62949d4d742bda26e91d7f4efdc92. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:02:29.430325 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-086cc53f-d1a5-4020-9681-0ecec682f577 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Getting quotas for user 91f20ede39c7447a83a3da87bc426215 and project 7df62949d4d742bda26e91d7f4efdc92. Resources: {'instances', 'cores', 'ram'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:02:29.442608 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-086cc53f-d1a5-4020-9681-0ecec682f577 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Going to run 1 instances... {{(pid=127863) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:02:29.445085 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-086cc53f-d1a5-4020-9681-0ecec682f577 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] [instance: 03a647c5-000a-49f7-80c5-0d98024d8c64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fe09c59-2ff9-4639-b39d-9a474e83ad91',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:02:29.491989 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-086cc53f-d1a5-4020-9681-0ecec682f577 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599860 Jan 28 01:02:29.492660 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 549/1128] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 01:02:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:02:29.503188 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-bf306d77-a852-4b98-8562-b6451b59cfba tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:29.503849 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-bf306d77-a852-4b98-8562-b6451b59cfba tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] [instance: 03a647c5-000a-49f7-80c5-0d98024d8c64] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:29.558481 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-bf306d77-a852-4b98-8562-b6451b59cfba tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f20ede39c7447a83a3da87bc426215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df62949d4d742bda26e91d7f4efdc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:29.565556 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-bf306d77-a852-4b98-8562-b6451b59cfba tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] 10.222.0.25 "GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64" status: 200 len: 1215 microversion: 2.1 time: 0.066540 Jan 28 01:02:29.566460 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 580/1129] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:29 2022] GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64 => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:30.583552 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-fbdb399b-3941-4c4d-9181-fa33c87dcff1 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:30.584194 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-fbdb399b-3941-4c4d-9181-fa33c87dcff1 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] [instance: 03a647c5-000a-49f7-80c5-0d98024d8c64] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:30.591651 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fbdb399b-3941-4c4d-9181-fa33c87dcff1 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:30.592039 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fbdb399b-3941-4c4d-9181-fa33c87dcff1 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:30.592990 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fbdb399b-3941-4c4d-9181-fa33c87dcff1 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:30.593506 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fbdb399b-3941-4c4d-9181-fa33c87dcff1 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:30.658604 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-fbdb399b-3941-4c4d-9181-fa33c87dcff1 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f20ede39c7447a83a3da87bc426215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df62949d4d742bda26e91d7f4efdc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:30.667371 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-fbdb399b-3941-4c4d-9181-fa33c87dcff1 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] 10.222.0.25 "GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64" status: 200 len: 1267 microversion: 2.1 time: 0.089144 Jan 28 01:02:30.668067 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 550/1130] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:30 2022] GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64 => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:31.684205 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-b5f66f94-325f-4741-ab0d-2d80a87fb01c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:31.685716 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-b5f66f94-325f-4741-ab0d-2d80a87fb01c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] [instance: 03a647c5-000a-49f7-80c5-0d98024d8c64] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:31.695490 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b5f66f94-325f-4741-ab0d-2d80a87fb01c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:31.696070 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b5f66f94-325f-4741-ab0d-2d80a87fb01c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:31.697016 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b5f66f94-325f-4741-ab0d-2d80a87fb01c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:31.697876 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-b5f66f94-325f-4741-ab0d-2d80a87fb01c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:31.868019 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-b5f66f94-325f-4741-ab0d-2d80a87fb01c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f20ede39c7447a83a3da87bc426215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df62949d4d742bda26e91d7f4efdc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:31.875674 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-b5f66f94-325f-4741-ab0d-2d80a87fb01c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] 10.222.0.25 "GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64" status: 200 len: 1315 microversion: 2.1 time: 0.195134 Jan 28 01:02:31.876692 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 581/1131] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:31 2022] GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:32.545728 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-4aeabf22-f226-405a-85db-0df5a26d9c86 req-5394d6eb-6635-47ea-81d7-677ad20f0267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03a647c5-000a-49f7-80c5-0d98024d8c64", "tag": "f9b29cdd-a962-4d84-93ad-27afe679ebb7"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:32.550072 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:32.550072 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 01:02:32.561243 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-4aeabf22-f226-405a-85db-0df5a26d9c86 req-5394d6eb-6635-47ea-81d7-677ad20f0267 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:32.562298 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-4aeabf22-f226-405a-85db-0df5a26d9c86 req-5394d6eb-6635-47ea-81d7-677ad20f0267 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:32.575136 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-4aeabf22-f226-405a-85db-0df5a26d9c86 req-5394d6eb-6635-47ea-81d7-677ad20f0267 service nova] Creating event network-changed:f9b29cdd-a962-4d84-93ad-27afe679ebb7 for instance 03a647c5-000a-49f7-80c5-0d98024d8c64 on hv-cinder-80952 Jan 28 01:02:32.593127 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-4aeabf22-f226-405a-85db-0df5a26d9c86 req-5394d6eb-6635-47ea-81d7-677ad20f0267 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051320 Jan 28 01:02:32.593884 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 551/1132] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:02:32.896403 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1f8b3b08-f405-4a88-b63f-09fb5d2d4d96 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:32.897829 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1f8b3b08-f405-4a88-b63f-09fb5d2d4d96 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] [instance: 03a647c5-000a-49f7-80c5-0d98024d8c64] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:32.906073 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1f8b3b08-f405-4a88-b63f-09fb5d2d4d96 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:32.906642 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1f8b3b08-f405-4a88-b63f-09fb5d2d4d96 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:32.908309 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1f8b3b08-f405-4a88-b63f-09fb5d2d4d96 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:32.908804 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1f8b3b08-f405-4a88-b63f-09fb5d2d4d96 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:33.060927 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-1f8b3b08-f405-4a88-b63f-09fb5d2d4d96 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f20ede39c7447a83a3da87bc426215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df62949d4d742bda26e91d7f4efdc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:33.070401 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1f8b3b08-f405-4a88-b63f-09fb5d2d4d96 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] 10.222.0.25 "GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64" status: 200 len: 1315 microversion: 2.1 time: 0.178195 Jan 28 01:02:33.071016 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 582/1133] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:32 2022] GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:34.089011 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-539da0f6-b314-4d9d-9a39-65c2c69c6bed tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:34.089711 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-539da0f6-b314-4d9d-9a39-65c2c69c6bed tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] [instance: 03a647c5-000a-49f7-80c5-0d98024d8c64] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:34.097237 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-539da0f6-b314-4d9d-9a39-65c2c69c6bed tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:34.097725 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-539da0f6-b314-4d9d-9a39-65c2c69c6bed tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:34.098538 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-539da0f6-b314-4d9d-9a39-65c2c69c6bed tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:34.098986 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-539da0f6-b314-4d9d-9a39-65c2c69c6bed tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:34.233756 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-539da0f6-b314-4d9d-9a39-65c2c69c6bed tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f20ede39c7447a83a3da87bc426215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df62949d4d742bda26e91d7f4efdc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:34.241864 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-539da0f6-b314-4d9d-9a39-65c2c69c6bed tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] 10.222.0.25 "GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64" status: 200 len: 1315 microversion: 2.1 time: 0.157348 Jan 28 01:02:34.242441 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 552/1134] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:34 2022] GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:35.258579 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-f2c660d8-69fb-431f-8798-3f2be24333be tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:35.259190 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-f2c660d8-69fb-431f-8798-3f2be24333be tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] [instance: 03a647c5-000a-49f7-80c5-0d98024d8c64] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:35.265635 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f2c660d8-69fb-431f-8798-3f2be24333be tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:35.266120 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f2c660d8-69fb-431f-8798-3f2be24333be tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:35.266907 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f2c660d8-69fb-431f-8798-3f2be24333be tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:35.267376 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-f2c660d8-69fb-431f-8798-3f2be24333be tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:35.401714 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-f2c660d8-69fb-431f-8798-3f2be24333be tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f20ede39c7447a83a3da87bc426215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df62949d4d742bda26e91d7f4efdc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:35.409967 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-f2c660d8-69fb-431f-8798-3f2be24333be tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] 10.222.0.25 "GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64" status: 200 len: 1315 microversion: 2.1 time: 0.155031 Jan 28 01:02:35.410543 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 583/1135] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:35 2022] GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:36.427670 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f9ce7e96-a6d8-4925-a16d-74ee03a2d91b tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:36.428275 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f9ce7e96-a6d8-4925-a16d-74ee03a2d91b tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] [instance: 03a647c5-000a-49f7-80c5-0d98024d8c64] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:36.434633 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f9ce7e96-a6d8-4925-a16d-74ee03a2d91b tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:36.435095 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f9ce7e96-a6d8-4925-a16d-74ee03a2d91b tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:36.435920 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f9ce7e96-a6d8-4925-a16d-74ee03a2d91b tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:36.436512 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f9ce7e96-a6d8-4925-a16d-74ee03a2d91b tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:36.575486 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f9ce7e96-a6d8-4925-a16d-74ee03a2d91b tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f20ede39c7447a83a3da87bc426215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df62949d4d742bda26e91d7f4efdc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:36.583811 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f9ce7e96-a6d8-4925-a16d-74ee03a2d91b tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] 10.222.0.25 "GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64" status: 200 len: 1315 microversion: 2.1 time: 0.160382 Jan 28 01:02:36.584406 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 553/1136] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:36 2022] GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:37.600774 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-11c79b1f-d8a1-4551-9fca-5c3135d0aaf9 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:37.601377 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-11c79b1f-d8a1-4551-9fca-5c3135d0aaf9 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] [instance: 03a647c5-000a-49f7-80c5-0d98024d8c64] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:37.608052 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-11c79b1f-d8a1-4551-9fca-5c3135d0aaf9 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:37.608505 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-11c79b1f-d8a1-4551-9fca-5c3135d0aaf9 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:37.609304 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-11c79b1f-d8a1-4551-9fca-5c3135d0aaf9 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:37.609922 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-11c79b1f-d8a1-4551-9fca-5c3135d0aaf9 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:37.745465 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-11c79b1f-d8a1-4551-9fca-5c3135d0aaf9 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f20ede39c7447a83a3da87bc426215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df62949d4d742bda26e91d7f4efdc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:37.755722 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-11c79b1f-d8a1-4551-9fca-5c3135d0aaf9 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] 10.222.0.25 "GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64" status: 200 len: 1315 microversion: 2.1 time: 0.158533 Jan 28 01:02:37.756334 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 584/1137] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:37 2022] GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:38.773010 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-43ade030-f032-4258-b32f-15f27f2c82e0 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:38.773714 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-43ade030-f032-4258-b32f-15f27f2c82e0 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] [instance: 03a647c5-000a-49f7-80c5-0d98024d8c64] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:38.780262 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-43ade030-f032-4258-b32f-15f27f2c82e0 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:38.780720 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-43ade030-f032-4258-b32f-15f27f2c82e0 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:38.781506 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-43ade030-f032-4258-b32f-15f27f2c82e0 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:38.782706 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-43ade030-f032-4258-b32f-15f27f2c82e0 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:38.915976 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-43ade030-f032-4258-b32f-15f27f2c82e0 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f20ede39c7447a83a3da87bc426215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df62949d4d742bda26e91d7f4efdc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:38.923693 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-43ade030-f032-4258-b32f-15f27f2c82e0 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] 10.222.0.25 "GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64" status: 200 len: 1315 microversion: 2.1 time: 0.154328 Jan 28 01:02:38.924254 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 554/1138] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:38 2022] GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:39.192684 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-50662160-b08b-4c70-bf57-f79ee8c8d944 req-fa8cc3e5-b2c8-43b5-a378-95a010dc4fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a647c5-000a-49f7-80c5-0d98024d8c64", "name": "network-vif-plugged", "status": "completed", "tag": "f9b29cdd-a962-4d84-93ad-27afe679ebb7"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:39.194498 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:39.194498 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 01:02:39.203096 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-50662160-b08b-4c70-bf57-f79ee8c8d944 req-fa8cc3e5-b2c8-43b5-a378-95a010dc4fe0 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:39.204415 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-50662160-b08b-4c70-bf57-f79ee8c8d944 req-fa8cc3e5-b2c8-43b5-a378-95a010dc4fe0 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:39.215950 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-50662160-b08b-4c70-bf57-f79ee8c8d944 req-fa8cc3e5-b2c8-43b5-a378-95a010dc4fe0 service nova] Creating event network-vif-plugged:f9b29cdd-a962-4d84-93ad-27afe679ebb7 for instance 03a647c5-000a-49f7-80c5-0d98024d8c64 on hv-cinder-80952 Jan 28 01:02:39.221945 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-50662160-b08b-4c70-bf57-f79ee8c8d944 req-fa8cc3e5-b2c8-43b5-a378-95a010dc4fe0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033155 Jan 28 01:02:39.222557 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 585/1139] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:02:39.941407 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e9785862-ebce-4a35-b31f-cd9aa7ee761c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:39.941940 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e9785862-ebce-4a35-b31f-cd9aa7ee761c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] [instance: 03a647c5-000a-49f7-80c5-0d98024d8c64] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:39.948540 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e9785862-ebce-4a35-b31f-cd9aa7ee761c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:39.948999 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e9785862-ebce-4a35-b31f-cd9aa7ee761c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:39.949845 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e9785862-ebce-4a35-b31f-cd9aa7ee761c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:39.950460 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e9785862-ebce-4a35-b31f-cd9aa7ee761c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:40.084269 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e9785862-ebce-4a35-b31f-cd9aa7ee761c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f20ede39c7447a83a3da87bc426215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df62949d4d742bda26e91d7f4efdc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:40.091849 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e9785862-ebce-4a35-b31f-cd9aa7ee761c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] 10.222.0.25 "GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64" status: 200 len: 1315 microversion: 2.1 time: 0.154888 Jan 28 01:02:40.092421 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 555/1140] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:39 2022] GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:40.570080 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-8068caa9-2551-4ad5-98a7-f9eb688f6ad8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:40.571329 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-8068caa9-2551-4ad5-98a7-f9eb688f6ad8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:40.571956 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-dcca3d20-a844-4dd5-80d8-f88ac864f732 req-a5898a29-ac25-472d-9275-e1d55af77d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c98be1-6473-4b8f-9c94-12eef8495893", "tag": "fa936154-1bb4-41ee-b929-553ae9ae8f60"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:40.573578 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:40.573578 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 01:02:40.579081 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8068caa9-2551-4ad5-98a7-f9eb688f6ad8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:40.579587 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8068caa9-2551-4ad5-98a7-f9eb688f6ad8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:40.580583 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8068caa9-2551-4ad5-98a7-f9eb688f6ad8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:40.581030 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8068caa9-2551-4ad5-98a7-f9eb688f6ad8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:40.581700 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-dcca3d20-a844-4dd5-80d8-f88ac864f732 req-a5898a29-ac25-472d-9275-e1d55af77d72 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:40.582229 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-dcca3d20-a844-4dd5-80d8-f88ac864f732 req-a5898a29-ac25-472d-9275-e1d55af77d72 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:40.593762 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-dcca3d20-a844-4dd5-80d8-f88ac864f732 req-a5898a29-ac25-472d-9275-e1d55af77d72 service nova] Creating event network-changed:fa936154-1bb4-41ee-b929-553ae9ae8f60 for instance 92c98be1-6473-4b8f-9c94-12eef8495893 on hv-cinder-80952 Jan 28 01:02:40.600108 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-dcca3d20-a844-4dd5-80d8-f88ac864f732 req-a5898a29-ac25-472d-9275-e1d55af77d72 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031790 Jan 28 01:02:40.600836 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 556/1141] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:02:40.610891 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-8068caa9-2551-4ad5-98a7-f9eb688f6ad8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Going to try to terminate instance {{(pid=127862) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:02:40.702551 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-8068caa9-2551-4ad5-98a7-f9eb688f6ad8 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "DELETE /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 204 len: 0 microversion: 2.1 time: 0.136390 Jan 28 01:02:40.703363 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 586/1142] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 01:02:40 2022] DELETE /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:02:40.712945 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7cda8d6c-4dd8-478c-b0fe-38f463f573e9 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:40.713636 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7cda8d6c-4dd8-478c-b0fe-38f463f573e9 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:40.721593 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7cda8d6c-4dd8-478c-b0fe-38f463f573e9 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:40.722050 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7cda8d6c-4dd8-478c-b0fe-38f463f573e9 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:40.722839 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7cda8d6c-4dd8-478c-b0fe-38f463f573e9 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:40.723516 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7cda8d6c-4dd8-478c-b0fe-38f463f573e9 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:40.871818 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7cda8d6c-4dd8-478c-b0fe-38f463f573e9 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:40.880344 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7cda8d6c-4dd8-478c-b0fe-38f463f573e9 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1578 microversion: 2.1 time: 0.171639 Jan 28 01:02:40.881703 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 557/1143] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:40 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:41.111140 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1a8797f8-cf25-496d-b58e-c0a373b88256 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:41.112148 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1a8797f8-cf25-496d-b58e-c0a373b88256 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] [instance: 03a647c5-000a-49f7-80c5-0d98024d8c64] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:41.119546 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1a8797f8-cf25-496d-b58e-c0a373b88256 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:41.120588 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1a8797f8-cf25-496d-b58e-c0a373b88256 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:41.120869 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1a8797f8-cf25-496d-b58e-c0a373b88256 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:41.121327 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1a8797f8-cf25-496d-b58e-c0a373b88256 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:41.277844 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-1a8797f8-cf25-496d-b58e-c0a373b88256 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f20ede39c7447a83a3da87bc426215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df62949d4d742bda26e91d7f4efdc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:41.288032 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1a8797f8-cf25-496d-b58e-c0a373b88256 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] 10.222.0.25 "GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64" status: 200 len: 1465 microversion: 2.1 time: 0.181942 Jan 28 01:02:41.288573 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 587/1144] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:41 2022] GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64 => generated 1465 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:41.325716 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-8d723b37-5119-4e83-bb25-98c319281848 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:41.326278 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-8d723b37-5119-4e83-bb25-98c319281848 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] [instance: 03a647c5-000a-49f7-80c5-0d98024d8c64] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:41.333526 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8d723b37-5119-4e83-bb25-98c319281848 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:41.333991 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8d723b37-5119-4e83-bb25-98c319281848 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:41.334798 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8d723b37-5119-4e83-bb25-98c319281848 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:41.335302 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8d723b37-5119-4e83-bb25-98c319281848 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:41.362426 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-8d723b37-5119-4e83-bb25-98c319281848 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] [instance: 03a647c5-000a-49f7-80c5-0d98024d8c64] Going to try to terminate instance {{(pid=127863) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:02:41.451139 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-8d723b37-5119-4e83-bb25-98c319281848 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] 10.222.0.25 "DELETE /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64" status: 204 len: 0 microversion: 2.1 time: 0.128880 Jan 28 01:02:41.451897 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 558/1145] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 01:02:41 2022] DELETE /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:02:41.460874 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-13e757b5-325c-4046-8b64-a89d4ca2e12b tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:41.461745 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-13e757b5-325c-4046-8b64-a89d4ca2e12b tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] [instance: 03a647c5-000a-49f7-80c5-0d98024d8c64] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:41.470082 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-13e757b5-325c-4046-8b64-a89d4ca2e12b tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:41.470703 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-13e757b5-325c-4046-8b64-a89d4ca2e12b tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:41.471796 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-13e757b5-325c-4046-8b64-a89d4ca2e12b tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:41.472267 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-13e757b5-325c-4046-8b64-a89d4ca2e12b tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:41.615220 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-13e757b5-325c-4046-8b64-a89d4ca2e12b tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f20ede39c7447a83a3da87bc426215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df62949d4d742bda26e91d7f4efdc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:41.623344 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-13e757b5-325c-4046-8b64-a89d4ca2e12b tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] 10.222.0.25 "GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64" status: 200 len: 1471 microversion: 2.1 time: 0.166141 Jan 28 01:02:41.623918 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 588/1146] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:41 2022] GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64 => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:41.898999 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c894a938-5ca0-431d-8ee1-ee486045bbbe tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:41.899744 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c894a938-5ca0-431d-8ee1-ee486045bbbe tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:41.906936 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c894a938-5ca0-431d-8ee1-ee486045bbbe tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:41.908284 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c894a938-5ca0-431d-8ee1-ee486045bbbe tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:41.909722 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c894a938-5ca0-431d-8ee1-ee486045bbbe tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:41.910534 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c894a938-5ca0-431d-8ee1-ee486045bbbe tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:42.064704 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-c894a938-5ca0-431d-8ee1-ee486045bbbe tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:42.072557 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c894a938-5ca0-431d-8ee1-ee486045bbbe tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1460 microversion: 2.1 time: 0.177621 Jan 28 01:02:42.073135 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 559/1147] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:41 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1460 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:42.642102 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-512b4ed1-6594-4d7a-97da-610c83627ae4 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:42.642731 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-512b4ed1-6594-4d7a-97da-610c83627ae4 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] [instance: 03a647c5-000a-49f7-80c5-0d98024d8c64] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:42.649861 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-512b4ed1-6594-4d7a-97da-610c83627ae4 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:42.650323 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-512b4ed1-6594-4d7a-97da-610c83627ae4 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:42.651445 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-512b4ed1-6594-4d7a-97da-610c83627ae4 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:42.651885 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-512b4ed1-6594-4d7a-97da-610c83627ae4 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:42.800064 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-512b4ed1-6594-4d7a-97da-610c83627ae4 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f20ede39c7447a83a3da87bc426215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df62949d4d742bda26e91d7f4efdc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:42.807831 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-512b4ed1-6594-4d7a-97da-610c83627ae4 tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] 10.222.0.25 "GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64" status: 200 len: 1471 microversion: 2.1 time: 0.169647 Jan 28 01:02:42.808790 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 589/1148] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:42 2022] GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:43.091774 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f13c4660-18fa-49de-8c1d-5f17c0501413 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:43.092400 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f13c4660-18fa-49de-8c1d-5f17c0501413 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:43.098957 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f13c4660-18fa-49de-8c1d-5f17c0501413 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:43.099462 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f13c4660-18fa-49de-8c1d-5f17c0501413 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:43.100254 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f13c4660-18fa-49de-8c1d-5f17c0501413 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:43.100707 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f13c4660-18fa-49de-8c1d-5f17c0501413 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:43.239402 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f13c4660-18fa-49de-8c1d-5f17c0501413 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:43.246874 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f13c4660-18fa-49de-8c1d-5f17c0501413 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1460 microversion: 2.1 time: 0.158799 Jan 28 01:02:43.247473 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 560/1149] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:43 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1460 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:43.830365 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-6c8f296f-fd90-4825-9084-260698e849cb tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:43.831622 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-6c8f296f-fd90-4825-9084-260698e849cb tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] [instance: 03a647c5-000a-49f7-80c5-0d98024d8c64] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:43.832436 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-509ff8de-9e43-4bdf-bee9-3395736327b9 req-e9e86f7e-b5ce-4305-833e-a6bc459ed047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a647c5-000a-49f7-80c5-0d98024d8c64", "name": "network-vif-deleted", "tag": "f9b29cdd-a962-4d84-93ad-27afe679ebb7"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:43.838914 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:43.838914 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 01:02:43.840813 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6c8f296f-fd90-4825-9084-260698e849cb tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:43.841271 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6c8f296f-fd90-4825-9084-260698e849cb tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:43.842129 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6c8f296f-fd90-4825-9084-260698e849cb tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:43.842660 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-6c8f296f-fd90-4825-9084-260698e849cb tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:43.851749 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-509ff8de-9e43-4bdf-bee9-3395736327b9 req-e9e86f7e-b5ce-4305-833e-a6bc459ed047 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:43.852209 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-509ff8de-9e43-4bdf-bee9-3395736327b9 req-e9e86f7e-b5ce-4305-833e-a6bc459ed047 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:43.869387 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-509ff8de-9e43-4bdf-bee9-3395736327b9 req-e9e86f7e-b5ce-4305-833e-a6bc459ed047 service nova] Creating event network-vif-deleted:f9b29cdd-a962-4d84-93ad-27afe679ebb7 for instance 03a647c5-000a-49f7-80c5-0d98024d8c64 on hv-cinder-80952 Jan 28 01:02:43.875232 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-509ff8de-9e43-4bdf-bee9-3395736327b9 req-e9e86f7e-b5ce-4305-833e-a6bc459ed047 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050134 Jan 28 01:02:43.877233 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 561/1150] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:02:43.912448 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-6c8f296f-fd90-4825-9084-260698e849cb tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91f20ede39c7447a83a3da87bc426215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df62949d4d742bda26e91d7f4efdc92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:43.922324 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-6c8f296f-fd90-4825-9084-260698e849cb tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] 10.222.0.25 "GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64" status: 200 len: 1429 microversion: 2.1 time: 0.099343 Jan 28 01:02:43.923594 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 590/1151] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:43 2022] GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64 => generated 1429 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:02:44.267563 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-4f1b3787-2fad-44d4-a02a-a2c4c4bc893f tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:44.268192 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-4f1b3787-2fad-44d4-a02a-a2c4c4bc893f tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:44.274506 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f1b3787-2fad-44d4-a02a-a2c4c4bc893f tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:44.274960 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f1b3787-2fad-44d4-a02a-a2c4c4bc893f tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:44.276053 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f1b3787-2fad-44d4-a02a-a2c4c4bc893f tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:44.276490 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-4f1b3787-2fad-44d4-a02a-a2c4c4bc893f tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:44.417757 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-4f1b3787-2fad-44d4-a02a-a2c4c4bc893f tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:44.426892 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-4f1b3787-2fad-44d4-a02a-a2c4c4bc893f tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1460 microversion: 2.1 time: 0.164665 Jan 28 01:02:44.427496 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 562/1152] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:44 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1460 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:44.940039 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-313c7ce0-3290-49ab-8c07-b7a49e74c29c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:44.940657 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-313c7ce0-3290-49ab-8c07-b7a49e74c29c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] [instance: 03a647c5-000a-49f7-80c5-0d98024d8c64] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:44.947111 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-313c7ce0-3290-49ab-8c07-b7a49e74c29c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:44.947604 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-313c7ce0-3290-49ab-8c07-b7a49e74c29c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:44.948402 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-313c7ce0-3290-49ab-8c07-b7a49e74c29c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:44.948851 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-313c7ce0-3290-49ab-8c07-b7a49e74c29c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:44.962678 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-313c7ce0-3290-49ab-8c07-b7a49e74c29c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] HTTP exception thrown: Instance 03a647c5-000a-49f7-80c5-0d98024d8c64 could not be found. Jan 28 01:02:44.963305 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-313c7ce0-3290-49ab-8c07-b7a49e74c29c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] Returning 404 to user: Instance 03a647c5-000a-49f7-80c5-0d98024d8c64 could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:02:44.964158 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-313c7ce0-3290-49ab-8c07-b7a49e74c29c tempest-VolumesNegativeTest-681805433 tempest-VolumesNegativeTest-681805433-project] 10.222.0.25 "GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64" status: 404 len: 111 microversion: 2.1 time: 0.028186 Jan 28 01:02:44.964717 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 591/1153] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:44 2022] GET /compute/v2.1/servers/03a647c5-000a-49f7-80c5-0d98024d8c64 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 01:02:45.444450 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a4e91feb-8dee-4f66-93b1-0fc0d4948653 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:45.445155 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a4e91feb-8dee-4f66-93b1-0fc0d4948653 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:45.451990 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a4e91feb-8dee-4f66-93b1-0fc0d4948653 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:45.452680 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a4e91feb-8dee-4f66-93b1-0fc0d4948653 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:45.453459 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a4e91feb-8dee-4f66-93b1-0fc0d4948653 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:45.454446 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a4e91feb-8dee-4f66-93b1-0fc0d4948653 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:45.593902 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a4e91feb-8dee-4f66-93b1-0fc0d4948653 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:45.602250 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a4e91feb-8dee-4f66-93b1-0fc0d4948653 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1460 microversion: 2.1 time: 0.161939 Jan 28 01:02:45.602918 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 563/1154] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:45 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1460 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:02:46.619819 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-982fe038-7354-4e5a-96e4-0f123c050e02 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:46.620464 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-982fe038-7354-4e5a-96e4-0f123c050e02 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:46.628141 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-982fe038-7354-4e5a-96e4-0f123c050e02 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:46.628613 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-982fe038-7354-4e5a-96e4-0f123c050e02 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:46.629431 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-982fe038-7354-4e5a-96e4-0f123c050e02 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:46.629887 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-982fe038-7354-4e5a-96e4-0f123c050e02 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:46.776933 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-982fe038-7354-4e5a-96e4-0f123c050e02 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:46.786134 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-982fe038-7354-4e5a-96e4-0f123c050e02 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1460 microversion: 2.1 time: 0.169882 Jan 28 01:02:46.786790 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 592/1155] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:46 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1460 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:47.229769 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-dcc87dc3-4ba6-4c6e-9b9d-67b3ecff2f2d req-c34f30e5-ae98-4e9c-b36b-99ad9cb7424d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c98be1-6473-4b8f-9c94-12eef8495893", "name": "network-vif-unplugged", "status": "completed", "tag": "fa936154-1bb4-41ee-b929-553ae9ae8f60"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:47.231939 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:47.231939 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 01:02:47.240255 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-dcc87dc3-4ba6-4c6e-9b9d-67b3ecff2f2d req-c34f30e5-ae98-4e9c-b36b-99ad9cb7424d service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:47.240870 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-dcc87dc3-4ba6-4c6e-9b9d-67b3ecff2f2d req-c34f30e5-ae98-4e9c-b36b-99ad9cb7424d service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:47.259301 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-dcc87dc3-4ba6-4c6e-9b9d-67b3ecff2f2d req-c34f30e5-ae98-4e9c-b36b-99ad9cb7424d service nova] Creating event network-vif-unplugged:fa936154-1bb4-41ee-b929-553ae9ae8f60 for instance 92c98be1-6473-4b8f-9c94-12eef8495893 on hv-cinder-80952 Jan 28 01:02:47.264749 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-dcc87dc3-4ba6-4c6e-9b9d-67b3ecff2f2d req-c34f30e5-ae98-4e9c-b36b-99ad9cb7424d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039841 Jan 28 01:02:47.265365 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 564/1156] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:02:47.802354 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-87d7a013-a9db-436d-bb2a-0b9f9b5c4d8f tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:47.803010 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-87d7a013-a9db-436d-bb2a-0b9f9b5c4d8f tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:47.809558 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-87d7a013-a9db-436d-bb2a-0b9f9b5c4d8f tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:47.810019 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-87d7a013-a9db-436d-bb2a-0b9f9b5c4d8f tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:47.810846 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-87d7a013-a9db-436d-bb2a-0b9f9b5c4d8f tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:47.811316 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-87d7a013-a9db-436d-bb2a-0b9f9b5c4d8f tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:47.950344 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-87d7a013-a9db-436d-bb2a-0b9f9b5c4d8f tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:47.958610 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-87d7a013-a9db-436d-bb2a-0b9f9b5c4d8f tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1460 microversion: 2.1 time: 0.160011 Jan 28 01:02:47.959192 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 593/1157] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:47 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1460 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:48.673041 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-9b054f20-7229-4134-9a54-225262133a17 req-4080bdf6-a359-4e7f-8f51-86e19eb36e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c98be1-6473-4b8f-9c94-12eef8495893", "name": "network-vif-deleted", "tag": "fa936154-1bb4-41ee-b929-553ae9ae8f60"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:48.675101 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:48.675101 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 01:02:48.684052 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-9b054f20-7229-4134-9a54-225262133a17 req-4080bdf6-a359-4e7f-8f51-86e19eb36e8c service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:48.684567 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-9b054f20-7229-4134-9a54-225262133a17 req-4080bdf6-a359-4e7f-8f51-86e19eb36e8c service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:48.697772 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-9b054f20-7229-4134-9a54-225262133a17 req-4080bdf6-a359-4e7f-8f51-86e19eb36e8c service nova] Creating event network-vif-deleted:fa936154-1bb4-41ee-b929-553ae9ae8f60 for instance 92c98be1-6473-4b8f-9c94-12eef8495893 on hv-cinder-80952 Jan 28 01:02:48.705135 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-9b054f20-7229-4134-9a54-225262133a17 req-4080bdf6-a359-4e7f-8f51-86e19eb36e8c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036402 Jan 28 01:02:48.706667 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 565/1158] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:02:48.976440 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-cdaa05db-332e-4106-b619-ea2195d244c3 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:48.977060 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-cdaa05db-332e-4106-b619-ea2195d244c3 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:48.995210 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cdaa05db-332e-4106-b619-ea2195d244c3 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:48.996137 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cdaa05db-332e-4106-b619-ea2195d244c3 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:48.996794 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cdaa05db-332e-4106-b619-ea2195d244c3 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:48.997910 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-cdaa05db-332e-4106-b619-ea2195d244c3 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:49.112124 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-cdaa05db-332e-4106-b619-ea2195d244c3 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:49.122332 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-cdaa05db-332e-4106-b619-ea2195d244c3 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 200 len: 1226 microversion: 2.1 time: 0.149740 Jan 28 01:02:49.123071 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 594/1159] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:48 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 1226 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:50.141284 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f8a487bb-e0a2-4070-a858-7f33d179043b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:50.142041 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f8a487bb-e0a2-4070-a858-7f33d179043b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 92c98be1-6473-4b8f-9c94-12eef8495893] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:50.148096 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f8a487bb-e0a2-4070-a858-7f33d179043b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:50.148553 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f8a487bb-e0a2-4070-a858-7f33d179043b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:50.149341 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f8a487bb-e0a2-4070-a858-7f33d179043b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:50.149873 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f8a487bb-e0a2-4070-a858-7f33d179043b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:50.164943 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-f8a487bb-e0a2-4070-a858-7f33d179043b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] HTTP exception thrown: Instance 92c98be1-6473-4b8f-9c94-12eef8495893 could not be found. Jan 28 01:02:50.165549 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f8a487bb-e0a2-4070-a858-7f33d179043b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Returning 404 to user: Instance 92c98be1-6473-4b8f-9c94-12eef8495893 could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:02:50.166385 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f8a487bb-e0a2-4070-a858-7f33d179043b tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893" status: 404 len: 111 microversion: 2.1 time: 0.029848 Jan 28 01:02:50.166947 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 566/1160] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:50 2022] GET /compute/v2.1/servers/92c98be1-6473-4b8f-9c94-12eef8495893 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:02:53.445815 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1b0bc394-79e7-4462-8a95-089c5dd473cc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:53.446324 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1b0bc394-79e7-4462-8a95-089c5dd473cc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:53.449684 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-27867dd7-10d4-4444-af3b-578b63bbd0e3 req-ad110fbe-72af-4bc5-bacf-5ada85bebb0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86b60be9-fc62-44f1-92b5-39e259500d4e", "tag": "0e8e3177-3ed6-4af8-a70f-1fe9fdeae77c"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:53.452500 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:53.452500 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 01:02:53.458893 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1b0bc394-79e7-4462-8a95-089c5dd473cc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:53.461070 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1b0bc394-79e7-4462-8a95-089c5dd473cc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:53.461529 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-27867dd7-10d4-4444-af3b-578b63bbd0e3 req-ad110fbe-72af-4bc5-bacf-5ada85bebb0c service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:53.462250 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-27867dd7-10d4-4444-af3b-578b63bbd0e3 req-ad110fbe-72af-4bc5-bacf-5ada85bebb0c service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:53.464368 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1b0bc394-79e7-4462-8a95-089c5dd473cc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:53.464830 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1b0bc394-79e7-4462-8a95-089c5dd473cc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:53.475882 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-27867dd7-10d4-4444-af3b-578b63bbd0e3 req-ad110fbe-72af-4bc5-bacf-5ada85bebb0c service nova] Creating event network-changed:0e8e3177-3ed6-4af8-a70f-1fe9fdeae77c for instance 86b60be9-fc62-44f1-92b5-39e259500d4e on hv-cinder-80952 Jan 28 01:02:53.481707 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-27867dd7-10d4-4444-af3b-578b63bbd0e3 req-ad110fbe-72af-4bc5-bacf-5ada85bebb0c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035758 Jan 28 01:02:53.482974 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 567/1161] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:02:53.516019 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1b0bc394-79e7-4462-8a95-089c5dd473cc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Going to try to terminate instance {{(pid=127862) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:02:53.685504 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1b0bc394-79e7-4462-8a95-089c5dd473cc tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "DELETE /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 204 len: 0 microversion: 2.1 time: 0.243363 Jan 28 01:02:53.686696 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 595/1162] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 01:02:53 2022] DELETE /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:02:53.696420 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3f1f7568-4f7b-4c1f-b5a0-2ce2c980352e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:53.697193 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-3f1f7568-4f7b-4c1f-b5a0-2ce2c980352e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:53.708975 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3f1f7568-4f7b-4c1f-b5a0-2ce2c980352e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:53.709451 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3f1f7568-4f7b-4c1f-b5a0-2ce2c980352e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:53.711008 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3f1f7568-4f7b-4c1f-b5a0-2ce2c980352e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:53.714541 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3f1f7568-4f7b-4c1f-b5a0-2ce2c980352e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:54.058915 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-3f1f7568-4f7b-4c1f-b5a0-2ce2c980352e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:54.067227 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3f1f7568-4f7b-4c1f-b5a0-2ce2c980352e tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1577 microversion: 2.1 time: 0.374971 Jan 28 01:02:54.071062 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 568/1163] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:53 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1577 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:55.098904 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-7c7ff041-2ab2-4718-a8f3-f8ff0720bdbf tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:55.099650 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-7c7ff041-2ab2-4718-a8f3-f8ff0720bdbf tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:55.107450 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7c7ff041-2ab2-4718-a8f3-f8ff0720bdbf tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:55.108163 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7c7ff041-2ab2-4718-a8f3-f8ff0720bdbf tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:55.109062 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7c7ff041-2ab2-4718-a8f3-f8ff0720bdbf tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:55.109580 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-7c7ff041-2ab2-4718-a8f3-f8ff0720bdbf tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:55.354978 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-7c7ff041-2ab2-4718-a8f3-f8ff0720bdbf tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:55.366380 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-7c7ff041-2ab2-4718-a8f3-f8ff0720bdbf tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1458 microversion: 2.1 time: 0.273209 Jan 28 01:02:55.371459 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 596/1164] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:55 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1458 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:55.535120 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-ac7248f4-f534-49f8-aa1f-f5f075f5f4d6 req-0477126b-f54a-4df7-bd6e-95baff4c183b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86b60be9-fc62-44f1-92b5-39e259500d4e", "name": "network-vif-deleted", "tag": "0e8e3177-3ed6-4af8-a70f-1fe9fdeae77c"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:02:55.538143 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:02:55.538143 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 01:02:55.550456 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-ac7248f4-f534-49f8-aa1f-f5f075f5f4d6 req-0477126b-f54a-4df7-bd6e-95baff4c183b service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:55.551539 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-ac7248f4-f534-49f8-aa1f-f5f075f5f4d6 req-0477126b-f54a-4df7-bd6e-95baff4c183b service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:55.572789 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-ac7248f4-f534-49f8-aa1f-f5f075f5f4d6 req-0477126b-f54a-4df7-bd6e-95baff4c183b service nova] Creating event network-vif-deleted:0e8e3177-3ed6-4af8-a70f-1fe9fdeae77c for instance 86b60be9-fc62-44f1-92b5-39e259500d4e on hv-cinder-80952 Jan 28 01:02:55.579547 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-ac7248f4-f534-49f8-aa1f-f5f075f5f4d6 req-0477126b-f54a-4df7-bd6e-95baff4c183b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048934 Jan 28 01:02:55.580846 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 569/1165] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:02:56.384073 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-127e960d-bb85-4005-861c-0e07c1d34d93 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:56.384819 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-127e960d-bb85-4005-861c-0e07c1d34d93 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:56.392323 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-127e960d-bb85-4005-861c-0e07c1d34d93 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:56.393160 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-127e960d-bb85-4005-861c-0e07c1d34d93 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:56.395142 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-127e960d-bb85-4005-861c-0e07c1d34d93 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:56.395837 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-127e960d-bb85-4005-861c-0e07c1d34d93 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:56.453761 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-127e960d-bb85-4005-861c-0e07c1d34d93 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:56.455738 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-127e960d-bb85-4005-861c-0e07c1d34d93 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:56.456491 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.objects.instance [None req-127e960d-bb85-4005-861c-0e07c1d34d93 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lazy-loading 'fault' on Instance uuid 86b60be9-fc62-44f1-92b5-39e259500d4e {{(pid=127862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:02:56.536754 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-127e960d-bb85-4005-861c-0e07c1d34d93 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a973914214249bebd8bd067a8c21ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfca2fc1b6c24ac7910c44e6d7936366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:02:56.546127 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-127e960d-bb85-4005-861c-0e07c1d34d93 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 200 len: 1184 microversion: 2.1 time: 0.165679 Jan 28 01:02:56.547306 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 597/1166] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:56 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 1184 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:02:57.568937 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3a1b5497-8b35-4537-a0a5-3ed300f77160 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:57.569673 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-3a1b5497-8b35-4537-a0a5-3ed300f77160 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: 86b60be9-fc62-44f1-92b5-39e259500d4e] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:57.577670 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3a1b5497-8b35-4537-a0a5-3ed300f77160 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:57.578691 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3a1b5497-8b35-4537-a0a5-3ed300f77160 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:57.580797 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3a1b5497-8b35-4537-a0a5-3ed300f77160 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:57.581256 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-3a1b5497-8b35-4537-a0a5-3ed300f77160 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:57.601347 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-3a1b5497-8b35-4537-a0a5-3ed300f77160 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] HTTP exception thrown: Instance 86b60be9-fc62-44f1-92b5-39e259500d4e could not be found. Jan 28 01:02:57.602245 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-3a1b5497-8b35-4537-a0a5-3ed300f77160 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Returning 404 to user: Instance 86b60be9-fc62-44f1-92b5-39e259500d4e could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:02:57.605075 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-3a1b5497-8b35-4537-a0a5-3ed300f77160 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e" status: 404 len: 111 microversion: 2.1 time: 0.042782 Jan 28 01:02:57.609689 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 570/1167] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:57 2022] GET /compute/v2.1/servers/86b60be9-fc62-44f1-92b5-39e259500d4e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:02:58.164410 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4bba33e1-6fb3-44fe-b650-c43991200118 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:58.165571 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4bba33e1-6fb3-44fe-b650-c43991200118 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:58.174584 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4bba33e1-6fb3-44fe-b650-c43991200118 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:58.175042 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4bba33e1-6fb3-44fe-b650-c43991200118 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:58.176084 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4bba33e1-6fb3-44fe-b650-c43991200118 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:58.176690 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4bba33e1-6fb3-44fe-b650-c43991200118 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:58.194834 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-4bba33e1-6fb3-44fe-b650-c43991200118 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] HTTP exception thrown: Instance ad5a37e9-9762-4d3f-9756-97f267719f8c could not be found. Jan 28 01:02:58.196185 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4bba33e1-6fb3-44fe-b650-c43991200118 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Returning 404 to user: Instance ad5a37e9-9762-4d3f-9756-97f267719f8c could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:02:58.197223 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4bba33e1-6fb3-44fe-b650-c43991200118 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 404 len: 111 microversion: 2.1 time: 0.037781 Jan 28 01:02:58.198334 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 598/1168] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 01:02:58 2022] DELETE /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:02:58.206656 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5347818c-5271-41d1-9f1b-061c14122107 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:58.207369 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-5347818c-5271-41d1-9f1b-061c14122107 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [instance: ad5a37e9-9762-4d3f-9756-97f267719f8c] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:02:58.213895 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5347818c-5271-41d1-9f1b-061c14122107 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:58.214345 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5347818c-5271-41d1-9f1b-061c14122107 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:58.215486 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5347818c-5271-41d1-9f1b-061c14122107 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:02:58.216093 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-5347818c-5271-41d1-9f1b-061c14122107 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:02:58.233169 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.wsgi [None req-5347818c-5271-41d1-9f1b-061c14122107 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] HTTP exception thrown: Instance ad5a37e9-9762-4d3f-9756-97f267719f8c could not be found. Jan 28 01:02:58.236480 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-5347818c-5271-41d1-9f1b-061c14122107 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Returning 404 to user: Instance ad5a37e9-9762-4d3f-9756-97f267719f8c could not be found. {{(pid=127863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:02:58.237625 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-5347818c-5271-41d1-9f1b-061c14122107 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c" status: 404 len: 111 microversion: 2.1 time: 0.035373 Jan 28 01:02:58.238703 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 571/1169] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:02:58 2022] GET /compute/v2.1/servers/ad5a37e9-9762-4d3f-9756-97f267719f8c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:02:59.670277 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-2cca7127-e91e-4088-b3da-1a0ae6c93189 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] Calling method '.version_select at 0x7fbbc24de670>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:02:59.673954 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2cca7127-e91e-4088-b3da-1a0ae6c93189 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [17c5871e-6b37-4028-b7eb-b3bd4797a6a7] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 28 01:03:00.686266 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO oslo.messaging._drivers.impl_rabbit [None req-2cca7127-e91e-4088-b3da-1a0ae6c93189 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] [17c5871e-6b37-4028-b7eb-b3bd4797a6a7] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 55502. Jan 28 01:03:00.723861 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-2cca7127-e91e-4088-b3da-1a0ae6c93189 tempest-TestVolumeBootPattern-674790657 tempest-TestVolumeBootPattern-674790657-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2038861869" status: 202 len: 0 microversion: 2.1 time: 1.057431 Jan 28 01:03:00.732543 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 599/1170] 10.222.0.25 () {58 vars in 1262 bytes} [Fri Jan 28 01:02:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2038861869 => generated 0 bytes in 1067 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:03:01.135094 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2ab25cfe-caf7-4fe4-b04e-0b3627fc9298 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Action: 'create', calling method: .version_select at 0x7fbbc241b9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-736947496"}} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:01.156963 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-2ab25cfe-caf7-4fe4-b04e-0b3627fc9298 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Getting quotas for project dbf9409383414a398b34cfc3de857902. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:03:01.163583 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-2ab25cfe-caf7-4fe4-b04e-0b3627fc9298 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Getting quotas for user 9b8a4aaa4d544cc4beacfe7b39ff2a28 and project dbf9409383414a398b34cfc3de857902. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:03:01.256809 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-2ab25cfe-caf7-4fe4-b04e-0b3627fc9298 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Getting quotas for project dbf9409383414a398b34cfc3de857902. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:03:01.264142 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.quota [None req-2ab25cfe-caf7-4fe4-b04e-0b3627fc9298 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Getting quotas for user 9b8a4aaa4d544cc4beacfe7b39ff2a28 and project dbf9409383414a398b34cfc3de857902. Resources: {'key_pairs'} {{(pid=127863) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:03:01.285286 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2ab25cfe-caf7-4fe4-b04e-0b3627fc9298 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.347965 Jan 28 01:03:01.290734 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 572/1171] 10.222.0.25 () {60 vars in 1157 bytes} [Fri Jan 28 01:03:00 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:18.456415 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-1bacd9a2-d922-41d3-998d-690a720d242e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1829352542", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-736947496", "security_groups": [{"name": "tempest-secgroup-smoke-572056485"}], "networks": [{"uuid": "454c7137-fbd1-473b-805c-37b04d415891"}], "block_device_mapping_v2": [{"uuid": "c46d0139-11c9-407d-93f5-5bfcca289cd4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:18.569081 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.network.neutron [None req-1bacd9a2-d922-41d3-998d-690a720d242e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] validate_networks() for [('454c7137-fbd1-473b-805c-37b04d415891', None, None, None, None, None)] {{(pid=127862) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:03:19.088411 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-1bacd9a2-d922-41d3-998d-690a720d242e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Flavor limits 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:03:19.088840 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-1bacd9a2-d922-41d3-998d-690a720d242e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Image limits 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:03:19.089316 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-1bacd9a2-d922-41d3-998d-690a720d242e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Flavor pref 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:03:19.089726 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-1bacd9a2-d922-41d3-998d-690a720d242e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Image pref 0:0:0 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:03:19.090143 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.virt.hardware [None req-1bacd9a2-d922-41d3-998d-690a720d242e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127862) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:03:19.099788 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1bacd9a2-d922-41d3-998d-690a720d242e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:19.100238 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1bacd9a2-d922-41d3-998d-690a720d242e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:19.101046 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1bacd9a2-d922-41d3-998d-690a720d242e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:19.101508 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-1bacd9a2-d922-41d3-998d-690a720d242e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:19.117960 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-1bacd9a2-d922-41d3-998d-690a720d242e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Getting quotas for project dbf9409383414a398b34cfc3de857902. Resources: {'instances', 'cores', 'ram'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:03:19.121886 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.quota [None req-1bacd9a2-d922-41d3-998d-690a720d242e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Getting quotas for user 9b8a4aaa4d544cc4beacfe7b39ff2a28 and project dbf9409383414a398b34cfc3de857902. Resources: {'instances', 'cores', 'ram'} {{(pid=127862) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:03:19.177029 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1bacd9a2-d922-41d3-998d-690a720d242e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Going to run 1 instances... {{(pid=127862) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:03:19.179220 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-1bacd9a2-d922-41d3-998d-690a720d242e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c46d0139-11c9-407d-93f5-5bfcca289cd4',volume_size=None,volume_type=None)] {{(pid=127862) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:03:19.304631 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-1bacd9a2-d922-41d3-998d-690a720d242e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.852908 Jan 28 01:03:19.310078 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 600/1172] 10.222.0.25 () {60 vars in 1146 bytes} [Fri Jan 28 01:03:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:03:19.316057 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-685c5e31-1787-4254-8f3f-b5871b2077c9 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:19.316679 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-685c5e31-1787-4254-8f3f-b5871b2077c9 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:19.372506 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-685c5e31-1787-4254-8f3f-b5871b2077c9 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:19.380101 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-685c5e31-1787-4254-8f3f-b5871b2077c9 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1088 microversion: 2.1 time: 0.068588 Jan 28 01:03:19.380691 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 573/1173] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:19 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:20.399225 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-65a05dcc-0a00-4866-a9f1-61faf5c87cdd tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:20.399876 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-65a05dcc-0a00-4866-a9f1-61faf5c87cdd tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:20.409924 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-65a05dcc-0a00-4866-a9f1-61faf5c87cdd tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:20.411368 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-65a05dcc-0a00-4866-a9f1-61faf5c87cdd tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:20.412680 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-65a05dcc-0a00-4866-a9f1-61faf5c87cdd tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:20.413728 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-65a05dcc-0a00-4866-a9f1-61faf5c87cdd tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:20.480123 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-65a05dcc-0a00-4866-a9f1-61faf5c87cdd tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:20.488930 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-65a05dcc-0a00-4866-a9f1-61faf5c87cdd tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1204 microversion: 2.1 time: 0.093871 Jan 28 01:03:20.489515 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 601/1174] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:20 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1204 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:03:21.506322 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-6bcda180-7baf-4a8d-a075-c5d5cd5062b5 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:21.506943 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-6bcda180-7baf-4a8d-a075-c5d5cd5062b5 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:21.513860 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6bcda180-7baf-4a8d-a075-c5d5cd5062b5 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:21.514308 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6bcda180-7baf-4a8d-a075-c5d5cd5062b5 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:21.515117 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6bcda180-7baf-4a8d-a075-c5d5cd5062b5 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:21.515587 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-6bcda180-7baf-4a8d-a075-c5d5cd5062b5 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:21.681346 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-6bcda180-7baf-4a8d-a075-c5d5cd5062b5 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:21.690209 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-6bcda180-7baf-4a8d-a075-c5d5cd5062b5 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1259 microversion: 2.1 time: 0.187541 Jan 28 01:03:21.691155 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 574/1175] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:21 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:21.983573 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-13cb40b8-c4f6-4e73-b6da-c8aa703af78e req-9cae1f14-8eda-425e-8885-8c85a7638c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad5f635-f03e-476a-b87e-466355bcd4bb", "tag": "d3f2dc96-4cd4-4d74-ba96-25c638fb8d2d"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:21.986727 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:03:21.986727 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 01:03:21.994954 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-13cb40b8-c4f6-4e73-b6da-c8aa703af78e req-9cae1f14-8eda-425e-8885-8c85a7638c11 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:21.995431 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-13cb40b8-c4f6-4e73-b6da-c8aa703af78e req-9cae1f14-8eda-425e-8885-8c85a7638c11 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:22.009379 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-13cb40b8-c4f6-4e73-b6da-c8aa703af78e req-9cae1f14-8eda-425e-8885-8c85a7638c11 service nova] Creating event network-changed:d3f2dc96-4cd4-4d74-ba96-25c638fb8d2d for instance fad5f635-f03e-476a-b87e-466355bcd4bb on hv-cinder-80952 Jan 28 01:03:22.015253 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-13cb40b8-c4f6-4e73-b6da-c8aa703af78e req-9cae1f14-8eda-425e-8885-8c85a7638c11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185052 Jan 28 01:03:22.016179 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 602/1176] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:03:22.708093 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-bd06da8d-af07-4198-af71-8063888af4ad tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:22.708695 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-bd06da8d-af07-4198-af71-8063888af4ad tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:22.714973 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bd06da8d-af07-4198-af71-8063888af4ad tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:22.715462 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bd06da8d-af07-4198-af71-8063888af4ad tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:22.716247 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bd06da8d-af07-4198-af71-8063888af4ad tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:22.716680 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-bd06da8d-af07-4198-af71-8063888af4ad tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:22.850639 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-bd06da8d-af07-4198-af71-8063888af4ad tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:22.858183 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-bd06da8d-af07-4198-af71-8063888af4ad tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1259 microversion: 2.1 time: 0.154328 Jan 28 01:03:22.858766 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 575/1177] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:22 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:23.875409 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-227a473d-abfb-4ab1-b376-ac95aa223f99 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:23.876246 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-227a473d-abfb-4ab1-b376-ac95aa223f99 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:23.884153 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-227a473d-abfb-4ab1-b376-ac95aa223f99 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:23.884607 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-227a473d-abfb-4ab1-b376-ac95aa223f99 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:23.885400 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-227a473d-abfb-4ab1-b376-ac95aa223f99 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:23.885840 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-227a473d-abfb-4ab1-b376-ac95aa223f99 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:24.024218 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-227a473d-abfb-4ab1-b376-ac95aa223f99 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:24.031795 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-227a473d-abfb-4ab1-b376-ac95aa223f99 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1259 microversion: 2.1 time: 0.160383 Jan 28 01:03:24.032316 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 603/1178] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:23 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:25.049063 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-fa26c3c2-e1c7-4d24-aa7a-96a9b26bfdf2 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:25.049650 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-fa26c3c2-e1c7-4d24-aa7a-96a9b26bfdf2 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:25.056365 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fa26c3c2-e1c7-4d24-aa7a-96a9b26bfdf2 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:25.056669 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fa26c3c2-e1c7-4d24-aa7a-96a9b26bfdf2 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:25.057433 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fa26c3c2-e1c7-4d24-aa7a-96a9b26bfdf2 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:25.057869 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-fa26c3c2-e1c7-4d24-aa7a-96a9b26bfdf2 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:25.194184 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-fa26c3c2-e1c7-4d24-aa7a-96a9b26bfdf2 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:25.201538 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-fa26c3c2-e1c7-4d24-aa7a-96a9b26bfdf2 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1259 microversion: 2.1 time: 0.157090 Jan 28 01:03:25.202108 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 576/1179] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:25 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:26.218310 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-559920cb-6b62-4e41-9fa8-1ac63797cc99 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:26.218858 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-559920cb-6b62-4e41-9fa8-1ac63797cc99 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:26.225971 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-559920cb-6b62-4e41-9fa8-1ac63797cc99 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:26.226422 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-559920cb-6b62-4e41-9fa8-1ac63797cc99 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:26.227205 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-559920cb-6b62-4e41-9fa8-1ac63797cc99 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:26.227670 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-559920cb-6b62-4e41-9fa8-1ac63797cc99 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:26.359493 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-559920cb-6b62-4e41-9fa8-1ac63797cc99 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:26.367345 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-559920cb-6b62-4e41-9fa8-1ac63797cc99 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1259 microversion: 2.1 time: 0.152858 Jan 28 01:03:26.367981 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 604/1180] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:26 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:27.385356 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-96f1113d-9963-418f-a318-af6c3311cd80 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:27.386274 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-96f1113d-9963-418f-a318-af6c3311cd80 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:27.393515 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-96f1113d-9963-418f-a318-af6c3311cd80 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:27.393961 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-96f1113d-9963-418f-a318-af6c3311cd80 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:27.394767 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-96f1113d-9963-418f-a318-af6c3311cd80 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:27.395204 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-96f1113d-9963-418f-a318-af6c3311cd80 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:27.532014 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-96f1113d-9963-418f-a318-af6c3311cd80 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:27.539535 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-96f1113d-9963-418f-a318-af6c3311cd80 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1259 microversion: 2.1 time: 0.157827 Jan 28 01:03:27.540105 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 577/1181] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:27 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:28.556992 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-27e3a137-b142-47d1-bab4-0be3118f0f43 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:28.557619 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-27e3a137-b142-47d1-bab4-0be3118f0f43 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:28.564953 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-27e3a137-b142-47d1-bab4-0be3118f0f43 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:28.565416 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-27e3a137-b142-47d1-bab4-0be3118f0f43 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:28.566219 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-27e3a137-b142-47d1-bab4-0be3118f0f43 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:28.566660 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-27e3a137-b142-47d1-bab4-0be3118f0f43 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:28.698456 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-27e3a137-b142-47d1-bab4-0be3118f0f43 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:28.706985 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-27e3a137-b142-47d1-bab4-0be3118f0f43 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1259 microversion: 2.1 time: 0.153642 Jan 28 01:03:28.707777 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 605/1182] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:28 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:29.724292 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-40001c9c-9716-4cc8-880e-a697b0930ff1 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:29.724819 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-40001c9c-9716-4cc8-880e-a697b0930ff1 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:29.731375 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-40001c9c-9716-4cc8-880e-a697b0930ff1 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:29.731842 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-40001c9c-9716-4cc8-880e-a697b0930ff1 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:29.732646 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-40001c9c-9716-4cc8-880e-a697b0930ff1 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:29.733091 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-40001c9c-9716-4cc8-880e-a697b0930ff1 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:29.883780 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-40001c9c-9716-4cc8-880e-a697b0930ff1 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:29.891805 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-40001c9c-9716-4cc8-880e-a697b0930ff1 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1259 microversion: 2.1 time: 0.172124 Jan 28 01:03:29.893361 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 578/1183] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:29 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:30.910075 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9d0b6592-6d32-4a19-848d-a2a3b4453bb4 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:30.910689 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9d0b6592-6d32-4a19-848d-a2a3b4453bb4 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:30.917226 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d0b6592-6d32-4a19-848d-a2a3b4453bb4 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:30.917684 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d0b6592-6d32-4a19-848d-a2a3b4453bb4 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:30.918478 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d0b6592-6d32-4a19-848d-a2a3b4453bb4 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:30.918924 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9d0b6592-6d32-4a19-848d-a2a3b4453bb4 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:31.051148 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9d0b6592-6d32-4a19-848d-a2a3b4453bb4 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:31.058730 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9d0b6592-6d32-4a19-848d-a2a3b4453bb4 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1259 microversion: 2.1 time: 0.153031 Jan 28 01:03:31.059850 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 606/1184] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:30 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:32.076247 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a149476a-bb30-4876-82fd-024f19d9d806 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:32.076780 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a149476a-bb30-4876-82fd-024f19d9d806 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:32.083438 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a149476a-bb30-4876-82fd-024f19d9d806 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:32.083896 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a149476a-bb30-4876-82fd-024f19d9d806 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:32.084691 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a149476a-bb30-4876-82fd-024f19d9d806 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:32.085135 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a149476a-bb30-4876-82fd-024f19d9d806 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:32.217724 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a149476a-bb30-4876-82fd-024f19d9d806 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:32.226205 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a149476a-bb30-4876-82fd-024f19d9d806 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1259 microversion: 2.1 time: 0.153791 Jan 28 01:03:32.226783 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 579/1185] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:32 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:33.242790 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d419a3ec-6b7d-4685-a92c-bd2ed5ac9b7c tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:33.243434 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d419a3ec-6b7d-4685-a92c-bd2ed5ac9b7c tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:33.249988 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d419a3ec-6b7d-4685-a92c-bd2ed5ac9b7c tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:33.250454 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d419a3ec-6b7d-4685-a92c-bd2ed5ac9b7c tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:33.251220 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d419a3ec-6b7d-4685-a92c-bd2ed5ac9b7c tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:33.252234 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d419a3ec-6b7d-4685-a92c-bd2ed5ac9b7c tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:33.393909 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d419a3ec-6b7d-4685-a92c-bd2ed5ac9b7c tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:33.402069 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d419a3ec-6b7d-4685-a92c-bd2ed5ac9b7c tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1259 microversion: 2.1 time: 0.162893 Jan 28 01:03:33.403158 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 607/1186] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:33 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:33.561144 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-eb09edd2-8b13-4c40-a496-cc93b2e9d01e req-0df2a11f-29f7-4976-b139-f2fd559875a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad5f635-f03e-476a-b87e-466355bcd4bb", "name": "network-vif-plugged", "status": "completed", "tag": "d3f2dc96-4cd4-4d74-ba96-25c638fb8d2d"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:33.562704 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:03:33.562704 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 01:03:33.570951 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-eb09edd2-8b13-4c40-a496-cc93b2e9d01e req-0df2a11f-29f7-4976-b139-f2fd559875a0 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:33.571449 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-eb09edd2-8b13-4c40-a496-cc93b2e9d01e req-0df2a11f-29f7-4976-b139-f2fd559875a0 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:33.583536 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-eb09edd2-8b13-4c40-a496-cc93b2e9d01e req-0df2a11f-29f7-4976-b139-f2fd559875a0 service nova] Creating event network-vif-plugged:d3f2dc96-4cd4-4d74-ba96-25c638fb8d2d for instance fad5f635-f03e-476a-b87e-466355bcd4bb on hv-cinder-80952 Jan 28 01:03:33.588676 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-eb09edd2-8b13-4c40-a496-cc93b2e9d01e req-0df2a11f-29f7-4976-b139-f2fd559875a0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096026 Jan 28 01:03:33.589279 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 580/1187] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:03:34.418663 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-5f26b968-005c-4d0d-928b-81fc037e2b09 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:34.419260 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-5f26b968-005c-4d0d-928b-81fc037e2b09 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:34.426544 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5f26b968-005c-4d0d-928b-81fc037e2b09 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:34.427141 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5f26b968-005c-4d0d-928b-81fc037e2b09 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:34.427963 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5f26b968-005c-4d0d-928b-81fc037e2b09 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:34.428403 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5f26b968-005c-4d0d-928b-81fc037e2b09 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:34.561305 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-5f26b968-005c-4d0d-928b-81fc037e2b09 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:34.569525 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-5f26b968-005c-4d0d-928b-81fc037e2b09 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1259 microversion: 2.1 time: 0.154548 Jan 28 01:03:34.570109 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 608/1188] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:34 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:35.587500 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-c388d369-4211-4d87-ab01-c4d45565d6f4 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:35.588112 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-c388d369-4211-4d87-ab01-c4d45565d6f4 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:35.594304 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c388d369-4211-4d87-ab01-c4d45565d6f4 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:35.594751 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c388d369-4211-4d87-ab01-c4d45565d6f4 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:35.596733 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c388d369-4211-4d87-ab01-c4d45565d6f4 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:35.597133 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-c388d369-4211-4d87-ab01-c4d45565d6f4 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:35.732514 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-c388d369-4211-4d87-ab01-c4d45565d6f4 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:35.740810 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-c388d369-4211-4d87-ab01-c4d45565d6f4 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1443 microversion: 2.1 time: 0.157838 Jan 28 01:03:35.741399 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 581/1189] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:35 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:35.757299 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-d3b637f7-f5ad-444b-9bdb-9a91e33f48c1 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:03:35.757912 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-d3b637f7-f5ad-444b-9bdb-9a91e33f48c1 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:03:35.764257 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d3b637f7-f5ad-444b-9bdb-9a91e33f48c1 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:35.764710 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d3b637f7-f5ad-444b-9bdb-9a91e33f48c1 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:35.765495 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d3b637f7-f5ad-444b-9bdb-9a91e33f48c1 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:35.765936 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-d3b637f7-f5ad-444b-9bdb-9a91e33f48c1 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:35.898753 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-d3b637f7-f5ad-444b-9bdb-9a91e33f48c1 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:03:35.906666 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-d3b637f7-f5ad-444b-9bdb-9a91e33f48c1 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1443 microversion: 2.1 time: 0.153029 Jan 28 01:03:35.907243 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 609/1190] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:03:35 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:03:37.964457 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-047e315a-75bf-4c71-b28b-4d3f199ce071 req-4c26b4ba-2e55-4093-a8c6-7bce7d2f777f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad5f635-f03e-476a-b87e-466355bcd4bb", "tag": "d3f2dc96-4cd4-4d74-ba96-25c638fb8d2d"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:03:37.966195 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:03:37.966195 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 01:03:37.974028 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-047e315a-75bf-4c71-b28b-4d3f199ce071 req-4c26b4ba-2e55-4093-a8c6-7bce7d2f777f service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:03:37.974477 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-047e315a-75bf-4c71-b28b-4d3f199ce071 req-4c26b4ba-2e55-4093-a8c6-7bce7d2f777f service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:03:37.985878 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-047e315a-75bf-4c71-b28b-4d3f199ce071 req-4c26b4ba-2e55-4093-a8c6-7bce7d2f777f service nova] Creating event network-changed:d3f2dc96-4cd4-4d74-ba96-25c638fb8d2d for instance fad5f635-f03e-476a-b87e-466355bcd4bb on hv-cinder-80952 Jan 28 01:03:37.991149 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-047e315a-75bf-4c71-b28b-4d3f199ce071 req-4c26b4ba-2e55-4093-a8c6-7bce7d2f777f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090178 Jan 28 01:03:37.992043 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 582/1191] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:05:03.602373 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:05:03.603100 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: Fri Jan 28 01:05:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:05:23.106487 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:05:23.107095 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: Fri Jan 28 01:05:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:05:35.522071 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-75bc9d13-d772-4fa1-8e52-5d6963b62845 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:35.522746 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-75bc9d13-d772-4fa1-8e52-5d6963b62845 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:35.528885 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-75bc9d13-d772-4fa1-8e52-5d6963b62845 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:35.529341 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-75bc9d13-d772-4fa1-8e52-5d6963b62845 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:35.530117 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-75bc9d13-d772-4fa1-8e52-5d6963b62845 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:35.530553 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-75bc9d13-d772-4fa1-8e52-5d6963b62845 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:35.553595 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.objects.instance [None req-75bc9d13-d772-4fa1-8e52-5d6963b62845 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lazy-loading 'flavor' on Instance uuid fad5f635-f03e-476a-b87e-466355bcd4bb {{(pid=127862) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:05:35.624279 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-75bc9d13-d772-4fa1-8e52-5d6963b62845 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "POST /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb/action" status: 202 len: 0 microversion: 2.1 time: 0.106970 Jan 28 01:05:35.624874 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 610/1192] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:35 2022] POST /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:05:35.631883 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3625a317-9d77-4e0f-9ee3-e2caa39a7e1d] AMQP server on 10.222.0.25:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jan 28 01:05:35.636169 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-e7cb0613-fb67-4d8c-8405-6132500567bd tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:35.636915 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-e7cb0613-fb67-4d8c-8405-6132500567bd tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:35.643549 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e7cb0613-fb67-4d8c-8405-6132500567bd tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:35.644016 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e7cb0613-fb67-4d8c-8405-6132500567bd tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:35.644815 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e7cb0613-fb67-4d8c-8405-6132500567bd tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:35.645317 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-e7cb0613-fb67-4d8c-8405-6132500567bd tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:35.778619 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-e7cb0613-fb67-4d8c-8405-6132500567bd tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:35.786367 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-e7cb0613-fb67-4d8c-8405-6132500567bd tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1568 microversion: 2.1 time: 0.156644 Jan 28 01:05:35.786922 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 583/1193] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:35 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:36.805181 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4282bfe1-fcf9-4ce8-bd68-101b8331247a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:36.805981 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4282bfe1-fcf9-4ce8-bd68-101b8331247a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:36.812159 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4282bfe1-fcf9-4ce8-bd68-101b8331247a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:36.812612 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4282bfe1-fcf9-4ce8-bd68-101b8331247a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:36.813405 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4282bfe1-fcf9-4ce8-bd68-101b8331247a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:36.813847 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4282bfe1-fcf9-4ce8-bd68-101b8331247a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:36.951088 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4282bfe1-fcf9-4ce8-bd68-101b8331247a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:36.958542 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4282bfe1-fcf9-4ce8-bd68-101b8331247a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1568 microversion: 2.1 time: 0.158437 Jan 28 01:05:36.959143 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 611/1194] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:36 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:37.976112 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-036141f5-230d-43f3-927f-925534e3b7de tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:37.976811 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-036141f5-230d-43f3-927f-925534e3b7de tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:37.984604 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-036141f5-230d-43f3-927f-925534e3b7de tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:37.985054 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-036141f5-230d-43f3-927f-925534e3b7de tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:37.985833 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-036141f5-230d-43f3-927f-925534e3b7de tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:37.986269 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-036141f5-230d-43f3-927f-925534e3b7de tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:37.991133 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO oslo.messaging._drivers.impl_rabbit [-] [3625a317-9d77-4e0f-9ee3-e2caa39a7e1d] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 55766. Jan 28 01:05:38.125049 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-036141f5-230d-43f3-927f-925534e3b7de tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:38.132425 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-036141f5-230d-43f3-927f-925534e3b7de tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1568 microversion: 2.1 time: 0.160029 Jan 28 01:05:38.133535 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 584/1195] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:37 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:39.149552 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-79a484fd-d5e2-42c8-8f52-282d8d20200e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:39.150097 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-79a484fd-d5e2-42c8-8f52-282d8d20200e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:39.156373 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-79a484fd-d5e2-42c8-8f52-282d8d20200e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:39.156838 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-79a484fd-d5e2-42c8-8f52-282d8d20200e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:39.157619 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-79a484fd-d5e2-42c8-8f52-282d8d20200e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:39.158062 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-79a484fd-d5e2-42c8-8f52-282d8d20200e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:39.290470 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-79a484fd-d5e2-42c8-8f52-282d8d20200e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:39.297947 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-79a484fd-d5e2-42c8-8f52-282d8d20200e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1568 microversion: 2.1 time: 0.152647 Jan 28 01:05:39.298721 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 612/1196] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:39 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:40.314900 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-a5641ebe-c5ec-42f2-8742-75433fed1a35 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:40.315518 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-a5641ebe-c5ec-42f2-8742-75433fed1a35 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:40.322479 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a5641ebe-c5ec-42f2-8742-75433fed1a35 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:40.322933 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a5641ebe-c5ec-42f2-8742-75433fed1a35 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:40.323756 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a5641ebe-c5ec-42f2-8742-75433fed1a35 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:40.324201 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-a5641ebe-c5ec-42f2-8742-75433fed1a35 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:40.457911 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-a5641ebe-c5ec-42f2-8742-75433fed1a35 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:40.465831 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-a5641ebe-c5ec-42f2-8742-75433fed1a35 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1568 microversion: 2.1 time: 0.154620 Jan 28 01:05:40.466414 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 585/1197] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:40 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:41.482635 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-a5720690-d119-4d45-9b51-2711e4c4d071 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:41.483249 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-a5720690-d119-4d45-9b51-2711e4c4d071 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:41.489769 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a5720690-d119-4d45-9b51-2711e4c4d071 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:41.490226 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a5720690-d119-4d45-9b51-2711e4c4d071 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:41.491015 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a5720690-d119-4d45-9b51-2711e4c4d071 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:41.491499 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-a5720690-d119-4d45-9b51-2711e4c4d071 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:41.622774 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-a5720690-d119-4d45-9b51-2711e4c4d071 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:41.630095 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-a5720690-d119-4d45-9b51-2711e4c4d071 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1568 microversion: 2.1 time: 0.151196 Jan 28 01:05:41.630661 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 613/1198] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:41 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:42.646656 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-06bafae7-44ff-418b-b102-7f068595a6af tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:42.647297 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-06bafae7-44ff-418b-b102-7f068595a6af tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:42.654298 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-06bafae7-44ff-418b-b102-7f068595a6af tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:42.654752 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-06bafae7-44ff-418b-b102-7f068595a6af tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:42.655571 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-06bafae7-44ff-418b-b102-7f068595a6af tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:42.656010 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-06bafae7-44ff-418b-b102-7f068595a6af tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:42.812779 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-06bafae7-44ff-418b-b102-7f068595a6af tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:42.820741 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-06bafae7-44ff-418b-b102-7f068595a6af tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1568 microversion: 2.1 time: 0.177680 Jan 28 01:05:42.821498 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 586/1199] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:42 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:43.839538 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-c7feb550-570e-4361-a208-5ec9b44e9442 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:43.840153 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-c7feb550-570e-4361-a208-5ec9b44e9442 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:43.847455 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c7feb550-570e-4361-a208-5ec9b44e9442 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:43.847912 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c7feb550-570e-4361-a208-5ec9b44e9442 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:43.849167 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c7feb550-570e-4361-a208-5ec9b44e9442 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:43.849980 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-c7feb550-570e-4361-a208-5ec9b44e9442 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:43.985132 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-c7feb550-570e-4361-a208-5ec9b44e9442 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:43.992612 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-c7feb550-570e-4361-a208-5ec9b44e9442 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1568 microversion: 2.1 time: 0.158222 Jan 28 01:05:43.993186 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 614/1200] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:43 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:45.010476 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-8c0cbd4f-f44c-43c6-9420-606de3ba5531 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:45.011083 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-8c0cbd4f-f44c-43c6-9420-606de3ba5531 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:45.017359 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8c0cbd4f-f44c-43c6-9420-606de3ba5531 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:45.017805 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8c0cbd4f-f44c-43c6-9420-606de3ba5531 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:45.018586 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8c0cbd4f-f44c-43c6-9420-606de3ba5531 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:45.019020 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-8c0cbd4f-f44c-43c6-9420-606de3ba5531 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:45.152444 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-8c0cbd4f-f44c-43c6-9420-606de3ba5531 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:45.160115 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-8c0cbd4f-f44c-43c6-9420-606de3ba5531 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1568 microversion: 2.1 time: 0.154192 Jan 28 01:05:45.160680 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 587/1201] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:45 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:46.176731 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-ebb2155e-fd9f-49a2-8123-674d72f56738 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:46.177343 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-ebb2155e-fd9f-49a2-8123-674d72f56738 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:46.184707 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ebb2155e-fd9f-49a2-8123-674d72f56738 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:46.185164 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ebb2155e-fd9f-49a2-8123-674d72f56738 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:46.185952 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ebb2155e-fd9f-49a2-8123-674d72f56738 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:46.186393 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-ebb2155e-fd9f-49a2-8123-674d72f56738 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:46.325914 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-ebb2155e-fd9f-49a2-8123-674d72f56738 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:46.339788 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-ebb2155e-fd9f-49a2-8123-674d72f56738 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1568 microversion: 2.1 time: 0.166213 Jan 28 01:05:46.340865 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 615/1202] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:46 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:47.364043 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-1266dc4b-e869-437a-b380-6bbca4fc4089 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:47.364688 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-1266dc4b-e869-437a-b380-6bbca4fc4089 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:47.370988 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1266dc4b-e869-437a-b380-6bbca4fc4089 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:47.371484 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1266dc4b-e869-437a-b380-6bbca4fc4089 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:47.372270 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1266dc4b-e869-437a-b380-6bbca4fc4089 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:47.372698 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-1266dc4b-e869-437a-b380-6bbca4fc4089 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:47.507585 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-1266dc4b-e869-437a-b380-6bbca4fc4089 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:47.515423 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-1266dc4b-e869-437a-b380-6bbca4fc4089 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1568 microversion: 2.1 time: 0.155128 Jan 28 01:05:47.515984 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 588/1203] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:47 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:48.532757 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-47158c43-25b3-46d1-bae7-e418d8bddd16 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:48.533395 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-47158c43-25b3-46d1-bae7-e418d8bddd16 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:48.540082 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-47158c43-25b3-46d1-bae7-e418d8bddd16 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:48.540581 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-47158c43-25b3-46d1-bae7-e418d8bddd16 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:48.541442 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-47158c43-25b3-46d1-bae7-e418d8bddd16 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:48.541890 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-47158c43-25b3-46d1-bae7-e418d8bddd16 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:48.676527 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-47158c43-25b3-46d1-bae7-e418d8bddd16 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:48.684880 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-47158c43-25b3-46d1-bae7-e418d8bddd16 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1568 microversion: 2.1 time: 0.155740 Jan 28 01:05:48.685466 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 616/1204] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:48 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:49.702226 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f0c2e63d-7520-46d3-8da4-43f7d0681e0e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:49.702781 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-f0c2e63d-7520-46d3-8da4-43f7d0681e0e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:49.709163 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f0c2e63d-7520-46d3-8da4-43f7d0681e0e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:49.709619 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f0c2e63d-7520-46d3-8da4-43f7d0681e0e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:49.710406 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f0c2e63d-7520-46d3-8da4-43f7d0681e0e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:49.711477 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-f0c2e63d-7520-46d3-8da4-43f7d0681e0e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:49.841724 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-f0c2e63d-7520-46d3-8da4-43f7d0681e0e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:49.848988 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f0c2e63d-7520-46d3-8da4-43f7d0681e0e tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1509 microversion: 2.1 time: 0.150706 Jan 28 01:05:49.849560 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 589/1205] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:49 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:49.865633 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-5aad707e-c4dc-4edc-b7c1-974d23a31090 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:49.866208 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-5aad707e-c4dc-4edc-b7c1-974d23a31090 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:49.873250 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5aad707e-c4dc-4edc-b7c1-974d23a31090 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:49.873710 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5aad707e-c4dc-4edc-b7c1-974d23a31090 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:49.874503 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5aad707e-c4dc-4edc-b7c1-974d23a31090 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:49.874942 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-5aad707e-c4dc-4edc-b7c1-974d23a31090 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:49.965375 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-5aad707e-c4dc-4edc-b7c1-974d23a31090 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "POST /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb/action" status: 202 len: 0 microversion: 2.1 time: 0.103343 Jan 28 01:05:49.965913 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 617/1206] 10.222.0.25 () {60 vars in 1277 bytes} [Fri Jan 28 01:05:49 2022] POST /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:05:49.973993 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-2dbc60ff-cf52-47ff-b771-9b1d0402baf7 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:49.974739 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-2dbc60ff-cf52-47ff-b771-9b1d0402baf7 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:49.981048 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2dbc60ff-cf52-47ff-b771-9b1d0402baf7 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:49.981511 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2dbc60ff-cf52-47ff-b771-9b1d0402baf7 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:49.982305 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2dbc60ff-cf52-47ff-b771-9b1d0402baf7 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:49.982748 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-2dbc60ff-cf52-47ff-b771-9b1d0402baf7 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:50.148138 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-2dbc60ff-cf52-47ff-b771-9b1d0402baf7 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:50.156781 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-2dbc60ff-cf52-47ff-b771-9b1d0402baf7 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1517 microversion: 2.1 time: 0.186537 Jan 28 01:05:50.157369 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 590/1207] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:49 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:51.174250 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-4f222e26-454a-4b57-8558-7e455df0f6b2 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:51.174864 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-4f222e26-454a-4b57-8558-7e455df0f6b2 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:51.181256 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4f222e26-454a-4b57-8558-7e455df0f6b2 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:51.181712 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4f222e26-454a-4b57-8558-7e455df0f6b2 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:51.182502 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4f222e26-454a-4b57-8558-7e455df0f6b2 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:51.182950 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-4f222e26-454a-4b57-8558-7e455df0f6b2 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:51.322075 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-4f222e26-454a-4b57-8558-7e455df0f6b2 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:51.329509 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-4f222e26-454a-4b57-8558-7e455df0f6b2 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1519 microversion: 2.1 time: 0.159514 Jan 28 01:05:51.330082 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 618/1208] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:51 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:52.196855 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-a5e04007-831a-44e4-9b11-71bec0b5bcdd req-ce5dc2c7-bb49-4f93-9437-b0705ba626ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad5f635-f03e-476a-b87e-466355bcd4bb", "name": "network-vif-unplugged", "status": "completed", "tag": "d3f2dc96-4cd4-4d74-ba96-25c638fb8d2d"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:05:52.198561 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:05:52.198561 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 01:05:52.206214 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-a5e04007-831a-44e4-9b11-71bec0b5bcdd req-ce5dc2c7-bb49-4f93-9437-b0705ba626ee service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:52.206662 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-a5e04007-831a-44e4-9b11-71bec0b5bcdd req-ce5dc2c7-bb49-4f93-9437-b0705ba626ee service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:52.218898 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-a5e04007-831a-44e4-9b11-71bec0b5bcdd req-ce5dc2c7-bb49-4f93-9437-b0705ba626ee service nova] Creating event network-vif-unplugged:d3f2dc96-4cd4-4d74-ba96-25c638fb8d2d for instance fad5f635-f03e-476a-b87e-466355bcd4bb on hv-cinder-80952 Jan 28 01:05:52.223983 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-a5e04007-831a-44e4-9b11-71bec0b5bcdd req-ce5dc2c7-bb49-4f93-9437-b0705ba626ee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030928 Jan 28 01:05:52.224585 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 591/1209] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:05:52.347563 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-28e3e994-df38-41aa-a6a2-4189111a1e0a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:52.348172 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-28e3e994-df38-41aa-a6a2-4189111a1e0a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:52.354426 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-28e3e994-df38-41aa-a6a2-4189111a1e0a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:52.354877 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-28e3e994-df38-41aa-a6a2-4189111a1e0a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:52.355705 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-28e3e994-df38-41aa-a6a2-4189111a1e0a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:52.356144 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-28e3e994-df38-41aa-a6a2-4189111a1e0a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:52.491113 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-28e3e994-df38-41aa-a6a2-4189111a1e0a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:52.499564 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-28e3e994-df38-41aa-a6a2-4189111a1e0a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1575 microversion: 2.1 time: 0.155619 Jan 28 01:05:52.500138 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 619/1210] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:52 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:53.517608 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-52c6efa6-5b81-4216-ad91-0cbb8d536445 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:53.518325 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-52c6efa6-5b81-4216-ad91-0cbb8d536445 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:53.525359 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-52c6efa6-5b81-4216-ad91-0cbb8d536445 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:53.525811 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-52c6efa6-5b81-4216-ad91-0cbb8d536445 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:53.526594 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-52c6efa6-5b81-4216-ad91-0cbb8d536445 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:53.527042 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-52c6efa6-5b81-4216-ad91-0cbb8d536445 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:53.657477 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-52c6efa6-5b81-4216-ad91-0cbb8d536445 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:53.666568 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-52c6efa6-5b81-4216-ad91-0cbb8d536445 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1575 microversion: 2.1 time: 0.153372 Jan 28 01:05:53.667148 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 592/1211] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:53 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:54.683167 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-148e6ee8-b51b-4e6f-a004-822d469fa98c tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:54.683821 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-148e6ee8-b51b-4e6f-a004-822d469fa98c tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:54.690566 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-148e6ee8-b51b-4e6f-a004-822d469fa98c tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:54.691022 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-148e6ee8-b51b-4e6f-a004-822d469fa98c tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:54.691846 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-148e6ee8-b51b-4e6f-a004-822d469fa98c tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:54.692295 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-148e6ee8-b51b-4e6f-a004-822d469fa98c tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:54.826767 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-148e6ee8-b51b-4e6f-a004-822d469fa98c tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:54.834227 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-148e6ee8-b51b-4e6f-a004-822d469fa98c tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1575 microversion: 2.1 time: 0.154871 Jan 28 01:05:54.834793 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 620/1212] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:54 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:55.851384 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-cfcc517d-734b-4d69-a8c3-e830361b40af tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:55.852007 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-cfcc517d-734b-4d69-a8c3-e830361b40af tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:55.858795 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cfcc517d-734b-4d69-a8c3-e830361b40af tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:55.859256 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cfcc517d-734b-4d69-a8c3-e830361b40af tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:55.860073 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cfcc517d-734b-4d69-a8c3-e830361b40af tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:55.860517 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-cfcc517d-734b-4d69-a8c3-e830361b40af tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:55.993657 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-cfcc517d-734b-4d69-a8c3-e830361b40af tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:56.001413 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-cfcc517d-734b-4d69-a8c3-e830361b40af tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1575 microversion: 2.1 time: 0.153751 Jan 28 01:05:56.001991 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 593/1213] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:55 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:57.018545 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-42aadef6-eb09-48bf-963e-af4cfcaa3342 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:57.019157 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-42aadef6-eb09-48bf-963e-af4cfcaa3342 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:57.025643 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-42aadef6-eb09-48bf-963e-af4cfcaa3342 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:57.026101 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-42aadef6-eb09-48bf-963e-af4cfcaa3342 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:57.026890 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-42aadef6-eb09-48bf-963e-af4cfcaa3342 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:57.027418 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-42aadef6-eb09-48bf-963e-af4cfcaa3342 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:57.163023 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-42aadef6-eb09-48bf-963e-af4cfcaa3342 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:57.170504 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-42aadef6-eb09-48bf-963e-af4cfcaa3342 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1575 microversion: 2.1 time: 0.155653 Jan 28 01:05:57.171073 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 621/1214] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:57 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:58.187679 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-19dffa7e-2426-4cec-8efd-83441330bc3a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:58.188225 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-19dffa7e-2426-4cec-8efd-83441330bc3a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:58.194995 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-19dffa7e-2426-4cec-8efd-83441330bc3a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:58.195483 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-19dffa7e-2426-4cec-8efd-83441330bc3a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:58.197065 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-19dffa7e-2426-4cec-8efd-83441330bc3a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:58.197513 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-19dffa7e-2426-4cec-8efd-83441330bc3a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:58.333637 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-19dffa7e-2426-4cec-8efd-83441330bc3a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:58.342250 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-19dffa7e-2426-4cec-8efd-83441330bc3a tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1575 microversion: 2.1 time: 0.158339 Jan 28 01:05:58.343039 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 594/1215] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:58 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:05:59.359582 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-8dd500ba-225f-4dca-adba-de58c076f34f tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:05:59.360220 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-8dd500ba-225f-4dca-adba-de58c076f34f tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:05:59.366451 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8dd500ba-225f-4dca-adba-de58c076f34f tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:59.366908 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8dd500ba-225f-4dca-adba-de58c076f34f tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:59.367728 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8dd500ba-225f-4dca-adba-de58c076f34f tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:05:59.368667 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-8dd500ba-225f-4dca-adba-de58c076f34f tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:05:59.499174 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-8dd500ba-225f-4dca-adba-de58c076f34f tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:05:59.506644 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-8dd500ba-225f-4dca-adba-de58c076f34f tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1562 microversion: 2.1 time: 0.150812 Jan 28 01:05:59.507236 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 622/1216] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:05:59 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:06:02.300571 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-9a4ede25-119d-4c91-b3b5-dd4dec6d13be req-db503c41-62bf-4d58-ac91-7190f51132c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad5f635-f03e-476a-b87e-466355bcd4bb", "name": "network-vif-plugged", "status": "completed", "tag": "d3f2dc96-4cd4-4d74-ba96-25c638fb8d2d"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:06:02.302138 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:06:02.302138 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 01:06:02.312170 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-9a4ede25-119d-4c91-b3b5-dd4dec6d13be req-db503c41-62bf-4d58-ac91-7190f51132c4 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:06:02.312170 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-9a4ede25-119d-4c91-b3b5-dd4dec6d13be req-db503c41-62bf-4d58-ac91-7190f51132c4 service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:06:02.324260 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-9a4ede25-119d-4c91-b3b5-dd4dec6d13be req-db503c41-62bf-4d58-ac91-7190f51132c4 service nova] Creating event network-vif-plugged:d3f2dc96-4cd4-4d74-ba96-25c638fb8d2d for instance fad5f635-f03e-476a-b87e-466355bcd4bb on hv-cinder-80952 Jan 28 01:06:02.329441 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-9a4ede25-119d-4c91-b3b5-dd4dec6d13be req-db503c41-62bf-4d58-ac91-7190f51132c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032497 Jan 28 01:06:02.330210 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 595/1217] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:07:16.080920 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-3cc63698-2cae-4f00-80c2-447a0ad4cf89 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:16.081490 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3cc63698-2cae-4f00-80c2-447a0ad4cf89 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:16.083173 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [req-6b28ec87-14d7-4256-a8ee-b5e70fc3d64d req-93975b24-3061-4e2d-a1b1-d14a6a58d1ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad5f635-f03e-476a-b87e-466355bcd4bb", "tag": "d3f2dc96-4cd4-4d74-ba96-25c638fb8d2d"}]} {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:07:16.084790 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:07:16.084790 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: warnings.warn(msg) Jan 28 01:07:16.087675 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3cc63698-2cae-4f00-80c2-447a0ad4cf89 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:16.088291 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3cc63698-2cae-4f00-80c2-447a0ad4cf89 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:16.089109 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3cc63698-2cae-4f00-80c2-447a0ad4cf89 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:16.089696 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-3cc63698-2cae-4f00-80c2-447a0ad4cf89 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:16.092769 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-6b28ec87-14d7-4256-a8ee-b5e70fc3d64d req-93975b24-3061-4e2d-a1b1-d14a6a58d1ed service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:16.093596 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [req-6b28ec87-14d7-4256-a8ee-b5e70fc3d64d req-93975b24-3061-4e2d-a1b1-d14a6a58d1ed service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:16.104525 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.compute.server_external_events [req-6b28ec87-14d7-4256-a8ee-b5e70fc3d64d req-93975b24-3061-4e2d-a1b1-d14a6a58d1ed service nova] Creating event network-changed:d3f2dc96-4cd4-4d74-ba96-25c638fb8d2d for instance fad5f635-f03e-476a-b87e-466355bcd4bb on hv-cinder-80952 Jan 28 01:07:16.110327 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [req-6b28ec87-14d7-4256-a8ee-b5e70fc3d64d req-93975b24-3061-4e2d-a1b1-d14a6a58d1ed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032615 Jan 28 01:07:16.111358 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 596/1218] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:07:16.121716 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-3cc63698-2cae-4f00-80c2-447a0ad4cf89 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Going to try to terminate instance {{(pid=127862) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:07:16.216731 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-3cc63698-2cae-4f00-80c2-447a0ad4cf89 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 204 len: 0 microversion: 2.1 time: 0.141250 Jan 28 01:07:16.217730 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 623/1219] 10.222.0.25 () {58 vars in 1238 bytes} [Fri Jan 28 01:07:16 2022] DELETE /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:07:16.228186 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-b595f460-b606-47ba-96dc-51fa890eb18f tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:16.229226 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-b595f460-b606-47ba-96dc-51fa890eb18f tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:16.237246 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b595f460-b606-47ba-96dc-51fa890eb18f tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:16.238014 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b595f460-b606-47ba-96dc-51fa890eb18f tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:16.239105 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b595f460-b606-47ba-96dc-51fa890eb18f tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:16.239845 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-b595f460-b606-47ba-96dc-51fa890eb18f tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:16.396082 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-b595f460-b606-47ba-96dc-51fa890eb18f tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:16.404112 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-b595f460-b606-47ba-96dc-51fa890eb18f tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1568 microversion: 2.1 time: 0.181301 Jan 28 01:07:16.404704 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 597/1220] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:16 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:17.422260 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-9ecfb52e-28a8-430e-b1c6-d3142c95df30 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:17.422863 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-9ecfb52e-28a8-430e-b1c6-d3142c95df30 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:17.429553 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9ecfb52e-28a8-430e-b1c6-d3142c95df30 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:17.430007 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9ecfb52e-28a8-430e-b1c6-d3142c95df30 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:17.430786 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9ecfb52e-28a8-430e-b1c6-d3142c95df30 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:17.431223 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-9ecfb52e-28a8-430e-b1c6-d3142c95df30 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:17.652912 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.policy [None req-9ecfb52e-28a8-430e-b1c6-d3142c95df30 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127862) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:17.665184 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-9ecfb52e-28a8-430e-b1c6-d3142c95df30 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1449 microversion: 2.1 time: 0.247723 Jan 28 01:07:17.665789 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 624/1221] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:17 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1449 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:18.682064 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-7691c668-ebd2-4bc6-b2b8-06befc0e3845 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:18.682687 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.compute.api [None req-7691c668-ebd2-4bc6-b2b8-06befc0e3845 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127863) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:18.690260 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7691c668-ebd2-4bc6-b2b8-06befc0e3845 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:18.690842 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7691c668-ebd2-4bc6-b2b8-06befc0e3845 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:18.691535 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7691c668-ebd2-4bc6-b2b8-06befc0e3845 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:18.691983 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG oslo_concurrency.lockutils [None req-7691c668-ebd2-4bc6-b2b8-06befc0e3845 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:18.707154 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [req-296ee6ff-57f7-4a2b-9cee-eff3d90e395c req-c983027a-d6dc-4765-a2ba-0ad2660ea84d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad5f635-f03e-476a-b87e-466355bcd4bb", "name": "network-vif-deleted", "tag": "d3f2dc96-4cd4-4d74-ba96-25c638fb8d2d"}]} {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:07:18.709135 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:07:18.709135 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: warnings.warn(msg) Jan 28 01:07:18.721201 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-296ee6ff-57f7-4a2b-9cee-eff3d90e395c req-c983027a-d6dc-4765-a2ba-0ad2660ea84d service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:18.721658 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [req-296ee6ff-57f7-4a2b-9cee-eff3d90e395c req-c983027a-d6dc-4765-a2ba-0ad2660ea84d service nova] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:18.734135 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.compute.server_external_events [req-296ee6ff-57f7-4a2b-9cee-eff3d90e395c req-c983027a-d6dc-4765-a2ba-0ad2660ea84d service nova] Creating event network-vif-deleted:d3f2dc96-4cd4-4d74-ba96-25c638fb8d2d for instance fad5f635-f03e-476a-b87e-466355bcd4bb on hv-cinder-80952 Jan 28 01:07:18.744111 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [req-296ee6ff-57f7-4a2b-9cee-eff3d90e395c req-c983027a-d6dc-4765-a2ba-0ad2660ea84d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037589 Jan 28 01:07:18.744111 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 625/1222] 10.222.0.25 () {64 vars in 1317 bytes} [Fri Jan 28 01:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:07:18.762448 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.policy [None req-7691c668-ebd2-4bc6-b2b8-06befc0e3845 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8a4aaa4d544cc4beacfe7b39ff2a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbf9409383414a398b34cfc3de857902', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127863) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:07:18.770519 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-7691c668-ebd2-4bc6-b2b8-06befc0e3845 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 200 len: 1382 microversion: 2.1 time: 0.092197 Jan 28 01:07:18.771099 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 598/1223] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:18 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 1382 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:07:19.790098 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-58ef6250-e736-4278-ad80-703044d4ab94 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '>' {{(pid=127862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:19.791164 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.compute.api [None req-58ef6250-e736-4278-ad80-703044d4ab94 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] [instance: fad5f635-f03e-476a-b87e-466355bcd4bb] Fetching instance by UUID {{(pid=127862) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:07:19.797253 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-58ef6250-e736-4278-ad80-703044d4ab94 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:19.797703 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-58ef6250-e736-4278-ad80-703044d4ab94 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:19.798489 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-58ef6250-e736-4278-ad80-703044d4ab94 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:07:19.798926 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG oslo_concurrency.lockutils [None req-58ef6250-e736-4278-ad80-703044d4ab94 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Lock "1f15678a-aa46-4c92-970a-a19695f4d8dc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:07:19.812427 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.wsgi [None req-58ef6250-e736-4278-ad80-703044d4ab94 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] HTTP exception thrown: Instance fad5f635-f03e-476a-b87e-466355bcd4bb could not be found. Jan 28 01:07:19.813054 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: DEBUG nova.api.openstack.wsgi [None req-58ef6250-e736-4278-ad80-703044d4ab94 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Returning 404 to user: Instance fad5f635-f03e-476a-b87e-466355bcd4bb could not be found. {{(pid=127862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:07:19.813885 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO nova.api.openstack.requestlog [None req-58ef6250-e736-4278-ad80-703044d4ab94 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb" status: 404 len: 111 microversion: 2.1 time: 0.029910 Jan 28 01:07:19.814442 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: [pid: 127862|app: 0|req: 626/1224] 10.222.0.25 () {58 vars in 1235 bytes} [Fri Jan 28 01:07:19 2022] GET /compute/v2.1/servers/fad5f635-f03e-476a-b87e-466355bcd4bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:07:19.973182 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: DEBUG nova.api.openstack.wsgi [None req-f6f2b52f-2582-48fe-bf0f-7e28d595a8c4 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] Calling method '.version_select at 0x7fbbc25754c0>' {{(pid=127863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:07:19.993207 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO nova.api.openstack.requestlog [None req-f6f2b52f-2582-48fe-bf0f-7e28d595a8c4 tempest-TestShelveInstance-1530291892 tempest-TestShelveInstance-1530291892-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-736947496" status: 202 len: 0 microversion: 2.1 time: 0.023694 Jan 28 01:07:19.994108 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: [pid: 127863|app: 0|req: 599/1225] 10.222.0.25 () {58 vars in 1250 bytes} [Fri Jan 28 01:07:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-736947496 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:08:08.423935 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:08:08.424559 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: Fri Jan 28 01:08:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:08:23.611038 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:08:23.611815 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: Fri Jan 28 01:08:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:08:43.114692 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:08:43.115436 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: Fri Jan 28 01:08:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:10:05.930988 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:10:05.932155 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: Fri Jan 28 01:10:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:10:18.622509 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:10:18.623175 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: Fri Jan 28 01:10:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:11:28.433536 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:11:28.434279 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: Fri Jan 28 01:11:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:11:43.619236 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:11:43.619945 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: Fri Jan 28 01:11:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:12:03.123000 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:12:03.123760 dv-cinder-809523-8-iscsi devstack@n-api.service[127862]: Fri Jan 28 01:12:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:12:18.178866 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:12:18.179582 dv-cinder-809523-8-iscsi devstack@n-api.service[127863]: Fri Jan 28 01:12:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!